-- Logs begin at Sun 2021-11-21 13:14:01 UTC, end at Sun 2021-11-21 14:13:22 UTC. -- Nov 21 13:43:43.232620 dv-cinder-768458-12-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 21 13:43:45.965867 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.common.config [-] Logging enabled! Nov 21 13:43:45.966465 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev215 Nov 21 13:43:45.966665 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=108931) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 21 13:43:45.969983 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.common.config [-] Logging enabled! Nov 21 13:43:45.970243 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev215 Nov 21 13:43:45.970563 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=108931) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 21 13:43:45.971508 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 21 13:43:45.971752 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 21 13:43:45.972161 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 21 13:43:45.972416 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 21 13:43:45.972649 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 21 13:43:45.972976 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.973415 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 21 13:43:45.973734 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.974038 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.974338 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.974645 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.974939 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.975226 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.975519 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.975840 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.976139 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.976426 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.976715 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.977012 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.977303 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] config_source = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.977596 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.977888 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.978176 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] debug = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.978462 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.978895 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.979325 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.979610 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.979939 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.980230 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.980512 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.980795 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.981085 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.981424 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] host = dv-cinder-768458-12-iscsi {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.981734 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.982028 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.982322 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.982614 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.982894 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.983178 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.983469 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.983749 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] log_dir = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.984061 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] log_file = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.984344 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.984646 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.984940 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.985235 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.985470 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.985701 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.986006 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.986301 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.986587 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.986872 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.987156 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.987441 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.987726 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.988032 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.988325 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.988617 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.988910 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.989194 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.989480 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.989758 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.990039 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.990330 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.990612 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.990892 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.991172 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.991465 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.991744 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.992053 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.992361 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.992654 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.992942 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.993234 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.993514 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.993803 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.994082 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.994359 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] use_journal = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.994640 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] use_json = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.994917 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.995193 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.995477 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.995756 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.996070 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.996350 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.996628 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.996917 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:45.997744 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:45.998051 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:45.998358 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:45.998649 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:45.998961 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:45.999249 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:45.999546 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:45.999851 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.000153 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.000450 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.000746 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.001033 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.001329 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.001615 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.001914 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.002225 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.002529 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.002830 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.003113 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.003398 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.003681 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.004004 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.004306 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.004594 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.004891 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.005187 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.005475 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.005778 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.006070 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.006369 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.006664 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.006947 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.007234 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.007533 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.007845 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.008128 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.008417 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.008714 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.009254 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.009556 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.009829 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.010113 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.010392 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.010672 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.010957 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.011252 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.011536 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.011828 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.012117 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.012403 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.012683 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.013530 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.013817 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.014098 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.014378 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.014663 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.014950 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.015230 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.015514 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.015795 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.016101 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.016380 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.016657 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.016938 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.017216 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.017495 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.017774 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.018053 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.018334 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.018611 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.018888 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.019166 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.019442 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.019721 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.020042 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.020346 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.020629 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.020913 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.021198 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.021480 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.021762 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.022044 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.022326 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.022609 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.022885 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.023181 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.023468 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.023757 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.024069 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.024377 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.024675 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.024964 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.025253 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.025536 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.025818 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.026107 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.026395 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.026693 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.026989 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.027288 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.027585 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.027907 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.028196 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.028577 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.028863 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:46.029085 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 21 13:43:46.029330 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=108931) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 21 13:43:46.462327 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=108931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:43:46.462618 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=108931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:43:46.462929 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=108931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 21 13:43:46.463289 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 21 13:43:46.792797 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.793105 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.793392 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.794622 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.794903 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.795295 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.831594 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.831901 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.832180 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.846103 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.846389 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.846662 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.875416 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.875699 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.876005 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.915949 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.916239 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:46.916767 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.164549 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.165149 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.165149 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.165364 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.166090 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.265399 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.265728 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.266021 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.266302 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.266579 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.266902 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.267170 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.267438 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.267703 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.268015 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.268285 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.268557 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.268826 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.269086 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.269348 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.269615 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.269878 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.270152 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.270425 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.270689 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.270967 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.271224 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.271511 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.271917 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.272176 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.272428 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.272837 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=108931) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 21 13:43:47.273087 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=108931) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 21 13:43:47.273330 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=108931) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 21 13:43:47.273573 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=108931) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 21 13:43:47.273816 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=108931) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 21 13:43:47.274058 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=108931) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 21 13:43:47.274431 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 21 13:43:47.277617 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 21 13:43:47.282207 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 21 13:43:47.286196 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(500, 549)])]) Nov 21 13:43:47.288024 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 21 13:43:47.288485 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 21 13:43:47.288828 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 21 13:43:47.289229 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 21 13:43:47.292120 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 21 13:43:47.292383 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 21 13:43:47.292741 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 21 13:43:47.298102 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 21 13:43:47.321296 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 21 13:43:47.321752 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.322058 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=108931) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Nov 21 13:43:47.322423 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.323829 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=108931) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 21 13:43:47.324141 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 21 13:43:47.324399 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 21 13:43:47.328400 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.328691 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:47.391527 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 21 13:43:47.391775 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 21 13:43:47.392046 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 21 13:43:47.392430 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 21 13:43:47.414319 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_db.sqlalchemy.engines [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 13:43:47.953904 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Initializing driver for type 'gre' Nov 21 13:43:47.954424 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] gre ID ranges: [(1, 1000)] Nov 21 13:43:48.003956 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Initializing driver for type 'local' Nov 21 13:43:48.004305 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Initializing driver for type 'vlan' Nov 21 13:43:48.016975 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] VlanTypeDriver initialization complete Nov 21 13:43:48.017339 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Initializing driver for type 'vxlan' Nov 21 13:43:48.017881 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] vxlan ID ranges: [(1, 1000)] Nov 21 13:43:48.066786 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Initializing extension driver 'port_security' Nov 21 13:43:48.067138 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.extensions.port_security [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] PortSecurityExtensionDriver initialization complete Nov 21 13:43:48.067476 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Initializing mechanism driver 'openvswitch' Nov 21 13:43:48.067875 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Initializing mechanism driver 'hyperv' Nov 21 13:43:48.074469 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.plugins.ml2.plugin [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=108931) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:43:48.075146 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > port after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.076124 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > port after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.076485 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > port after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.077031 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=108931) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 21 13:43:48.077471 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > subnet after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.077833 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > subnet after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.078185 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > subnet after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.078597 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=108931) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 21 13:43:48.079011 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > network after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.079362 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > network after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.079708 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > network after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.080139 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=108931) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 21 13:43:48.080549 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > security_group after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.080900 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > security_group after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.081246 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > security_group after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.081789 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=108931) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 21 13:43:48.082206 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.082563 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.082913 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.083319 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=108931) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 21 13:43:48.083724 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > address_group after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.084101 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > address_group after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.084446 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > address_group after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.084849 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=108931) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 21 13:43:48.085233 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] ML2 OVO RPC backend initialized. {{(pid=108931) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 21 13:43:48.085949 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router_interface after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.086308 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router_interface after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.086730 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > network before_response 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.087100 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > networks before_response 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.087437 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > port before_response 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.087784 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > ports before_response 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.088158 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > subnet before_response 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.088502 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > subnets before_response 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.088854 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > network after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.089195 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > network after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.089533 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > network after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.089874 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > port after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.090217 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > port after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.090560 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > port after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.090904 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > subnet after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.091244 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > subnet after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.091585 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > subnet after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.092187 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.plugin [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Modular L2 Plugin initialization complete Nov 21 13:43:48.092522 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading services supported by the core plugin {{(pid=108931) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 21 13:43:48.092850 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.plugins.ml2.managers [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Got port-security extension from driver 'port_security' Nov 21 13:43:48.093316 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.extensions.vlantransparent [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Disabled vlantransparent extension. Nov 21 13:43:48.093804 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=108931) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 21 13:43:48.094123 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading Plugin: router Nov 21 13:43:48.129879 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router_interface before_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.130273 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router after_create 55549900 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.130644 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router before_create 55549900 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.131011 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router_interface before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.131388 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router_interface after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.131747 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router after_delete 55549900 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.132136 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > floatingip after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.132488 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > floatingip after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.132854 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router after_create 55549900 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.133208 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router after_update 55549900 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.133563 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router after_update 55549900 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.134167 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.134531 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router after_update 55549900 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.134945 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router precommit_update 55549900 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.135316 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: port after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.135659 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: port after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.136032 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: subnet after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.136376 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.136730 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > port precommit_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.137083 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router precommit_create 55549900 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.137432 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: port before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.138327 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router precommit_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.138695 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router after_update 55549900 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.139041 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router precommit_delete 55549900 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.139397 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router precommit_create 55549900 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.139762 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router_interface after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.140131 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router precommit_update 55549900 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.140499 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > agent after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.140851 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > agent after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.141198 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > network after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.142058 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Tracking information for resource: router configured {{(pid=108931) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 21 13:43:48.142394 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Tracking information for resource: floatingip configured {{(pid=108931) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 21 13:43:48.147422 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.db.l3_agentschedulers_db [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 21 13:43:48.148047 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: port after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.148416 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: port after_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.148773 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: port after_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.149128 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: port after_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.149920 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router before_create 55550100 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.150289 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router precommit_delete 55550100 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.150654 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router precommit_create 55550100 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.151013 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > router precommit_update 55550100 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.155969 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.services.provider_configuration [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service providers = [] {{(pid=108931) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 21 13:43:48.156339 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.db.servicetype_db [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=108931) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 21 13:43:48.159301 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.services.service_base [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=108931) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 21 13:43:48.159658 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.services.service_base [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=108931) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 21 13:43:48.160037 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.services.service_base [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=108931) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 21 13:43:48.160936 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.services.service_base [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=108931) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 21 13:43:48.161312 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.services.service_base [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 21 13:43:48.161686 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=108931) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 21 13:43:48.162029 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 21 13:43:48.173043 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Successfully loaded METERING plugin. Description: METERING {{(pid=108931) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 21 13:43:48.173566 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading Plugin: auto_allocate Nov 21 13:43:48.179209 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: network precommit_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.179586 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: network precommit_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.180132 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=108931) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 21 13:43:48.180461 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading Plugin: tag Nov 21 13:43:48.187541 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=108931) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 21 13:43:48.187896 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading Plugin: timestamp Nov 21 13:43:48.191931 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=108931) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 21 13:43:48.192268 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading Plugin: network_ip_availability Nov 21 13:43:48.197739 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.198114 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.198473 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.199185 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=108931) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 21 13:43:48.199507 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading Plugin: flavors Nov 21 13:43:48.204391 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=108931) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 21 13:43:48.204680 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading Plugin: revisions Nov 21 13:43:48.208989 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=108931) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 21 13:43:48.209385 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_concurrency.lockutils [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.746s {{(pid=108931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 21 13:43:48.210133 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=108931) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 21 13:43:48.210473 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Initializing extension manager. Nov 21 13:43:48.210995 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: __init__.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.211342 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: __pycache__ {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.211681 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.212046 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: address_group.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.212805 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.213368 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: address-group Nov 21 13:43:48.213700 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: address_scope.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.214601 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.215113 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: address-scope Nov 21 13:43:48.215442 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: admin_state_down_before_update.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.216928 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.217436 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: router-admin-state-down-before-update Nov 21 13:43:48.217765 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: agent.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.218473 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.218983 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: agent Nov 21 13:43:48.219315 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: agent_resources_synced.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.220252 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.220758 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: agent-resources-synced Nov 21 13:43:48.221087 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: allowedaddresspairs.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.222882 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.223400 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: allowed-address-pairs Nov 21 13:43:48.223730 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: auto_allocated_topology.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.224846 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.225358 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: auto-allocated-topology Nov 21 13:43:48.225689 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: availability_zone.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.226395 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.226902 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: availability_zone Nov 21 13:43:48.227229 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: availability_zone_filter.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.228189 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.228703 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: availability_zone_filter Nov 21 13:43:48.229034 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: data_plane_status.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.229950 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.230454 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension data-plane-status not supported by any of loaded plugins Nov 21 13:43:48.230780 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: default_subnetpools.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.232268 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.232776 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: default-subnetpools Nov 21 13:43:48.233101 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: dhcpagentscheduler.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.233915 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.234422 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: dhcp_agent_scheduler Nov 21 13:43:48.234750 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: dns.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.235674 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.236214 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension dns-integration not supported by any of loaded plugins Nov 21 13:43:48.236541 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: dns_domain_ports.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.237474 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.237985 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 21 13:43:48.238312 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.239233 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.239739 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 21 13:43:48.240091 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: dvr.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.240769 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.241275 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: dvr Nov 21 13:43:48.241601 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: ecmp_routes.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.242524 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.243026 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension ecmp_routes not supported by any of loaded plugins Nov 21 13:43:48.243350 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: empty_string_filtering.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.244290 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.244796 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: empty-string-filtering Nov 21 13:43:48.245119 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.246047 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.246548 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 21 13:43:48.246875 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.247849 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.248352 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 21 13:43:48.248676 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: external_net.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.249600 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.250103 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: external-net Nov 21 13:43:48.250427 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: extra_dhcp_opt.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.251336 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.251866 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: extra_dhcp_opt Nov 21 13:43:48.252194 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: extraroute.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.253109 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.253611 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: extraroute Nov 21 13:43:48.253937 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: extraroute_atomic.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.254972 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.255478 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: extraroute-atomic Nov 21 13:43:48.255817 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: filter_validation.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.256499 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.257006 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: filter-validation Nov 21 13:43:48.257335 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: fip_pf_description.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.258248 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.258748 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 21 13:43:48.259330 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: fip_port_details.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.260287 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.260792 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: fip-port-details Nov 21 13:43:48.261119 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: flavors.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.262357 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.262904 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: flavors Nov 21 13:43:48.263236 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.264946 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.265472 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 21 13:43:48.265808 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: floatingip_pools.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.266513 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.267036 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: floatingip-pools Nov 21 13:43:48.267367 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: ip_allocation.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.268342 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.268851 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension ip_allocation not supported by any of loaded plugins Nov 21 13:43:48.269181 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: ip_substring_port_filtering.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.270109 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.270621 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: ip-substring-filtering Nov 21 13:43:48.270955 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: l2_adjacency.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.271924 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.272428 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension l2_adjacency not supported by any of loaded plugins Nov 21 13:43:48.272753 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: l3.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.273874 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.274396 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: router Nov 21 13:43:48.274727 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: l3_conntrack_helper.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.277045 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.277573 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 21 13:43:48.277909 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: l3_ext_gw_mode.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.279419 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.279975 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: ext-gw-mode Nov 21 13:43:48.280308 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: l3_ext_ha_mode.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.281247 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.281761 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: l3-ha Nov 21 13:43:48.282092 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: l3_flavors.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.283024 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.283543 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: l3-flavors Nov 21 13:43:48.283896 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.284823 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.285335 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: l3-port-ip-change-not-allowed Nov 21 13:43:48.285666 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: l3agentscheduler.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.286707 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.287220 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: l3_agent_scheduler Nov 21 13:43:48.287834 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: local_ip.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.289328 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.289853 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension local_ip not supported by any of loaded plugins Nov 21 13:43:48.290191 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: logging.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.291694 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.292252 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension logging not supported by any of loaded plugins Nov 21 13:43:48.292587 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: metering.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.293338 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.293932 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: metering Nov 21 13:43:48.294804 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.295940 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.296460 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: metering_source_and_destination_fields Nov 21 13:43:48.296797 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: multiprovidernet.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.297738 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.298250 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: multi-provider Nov 21 13:43:48.298580 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: netmtu.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.299507 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.300043 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: net-mtu Nov 21 13:43:48.300377 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: netmtu_writable.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.301309 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.301820 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: net-mtu-writable Nov 21 13:43:48.302149 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: network_availability_zone.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.302829 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.303332 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: network_availability_zone Nov 21 13:43:48.303656 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: network_ip_availability.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.304799 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.305315 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: network-ip-availability Nov 21 13:43:48.305642 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: network_segment_range.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.306413 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.306926 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension network-segment-range not supported by any of loaded plugins Nov 21 13:43:48.307253 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: pagination.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.309755 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.310108 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: pagination Nov 21 13:43:48.310449 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: port_device_profile.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.311393 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.311947 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: port-device-profile Nov 21 13:43:48.312285 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: port_mac_address_regenerate.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.313233 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.313747 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: port-mac-address-regenerate Nov 21 13:43:48.314080 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: port_numa_affinity_policy.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.315011 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.315520 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: port-numa-affinity-policy Nov 21 13:43:48.315875 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: port_resource_request.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.316822 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.317326 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension port-resource-request not supported by any of loaded plugins Nov 21 13:43:48.317657 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: port_resource_request_groups.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.318628 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.319140 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 21 13:43:48.319474 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: portbindings.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.320433 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.320946 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: binding Nov 21 13:43:48.321277 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: portbindings_extended.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.322556 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.323073 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: binding-extended Nov 21 13:43:48.323409 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: portsecurity.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.324379 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.324889 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: port-security Nov 21 13:43:48.325243 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: project_id.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.326235 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.326574 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: project-id Nov 21 13:43:48.326902 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: providernet.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.327864 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.328379 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: provider Nov 21 13:43:48.328706 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: qos.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.332358 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.332885 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension qos not supported by any of loaded plugins Nov 21 13:43:48.333221 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: qos_bw_limit_direction.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.334488 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.335000 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 21 13:43:48.335336 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.336300 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.336818 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 21 13:43:48.337152 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: qos_default.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.338077 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.338594 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension qos-default not supported by any of loaded plugins Nov 21 13:43:48.338908 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: qos_fip.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.339570 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.340107 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension qos-fip not supported by any of loaded plugins Nov 21 13:43:48.340437 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: qos_gateway_ip.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.341886 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.342391 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 21 13:43:48.342719 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: qos_port_network_policy.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.343644 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.344184 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 21 13:43:48.344513 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.345578 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.346096 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 21 13:43:48.346427 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: qos_pps_rule.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.347618 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.348174 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension qos-pps not supported by any of loaded plugins Nov 21 13:43:48.348506 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: qos_rule_type_details.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.349442 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.349960 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 21 13:43:48.350291 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: qos_rules_alias.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.351343 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.351884 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 21 13:43:48.352220 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: quota_check_limit.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.353142 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.353657 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: quota-check-limit Nov 21 13:43:48.353985 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: quotasv2.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.354910 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.355243 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: quotas Nov 21 13:43:48.355570 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: quotasv2_detail.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.359539 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.359920 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: quota_details Nov 21 13:43:48.360259 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: rbac.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.361322 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.361857 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: rbac-policies Nov 21 13:43:48.362190 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: rbac_address_group.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.363133 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.363654 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: rbac-address-group Nov 21 13:43:48.364013 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: rbac_address_scope.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.364949 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.365462 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: rbac-address-scope Nov 21 13:43:48.365790 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: rbac_security_groups.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.366718 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.367230 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: rbac-security-groups Nov 21 13:43:48.367557 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: rbac_subnetpool.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.368506 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.369024 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: rbac-subnetpool Nov 21 13:43:48.369351 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: revisionifmatch.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.370278 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.370800 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: revision-if-match Nov 21 13:43:48.371130 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: revisions.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.372375 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.372891 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: standard-attr-revisions Nov 21 13:43:48.373220 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: router_availability_zone.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.373899 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.374408 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: router_availability_zone Nov 21 13:43:48.374735 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: routerservicetype.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.375661 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.376202 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension router-service-type not supported by any of loaded plugins Nov 21 13:43:48.376532 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.377538 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.378053 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: security-groups-normalized-cidr Nov 21 13:43:48.378380 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: security_groups_port_filtering.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.379316 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.379857 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: port-security-groups-filtering Nov 21 13:43:48.380189 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: security_groups_remote_address_group.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.381124 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.381661 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: security-groups-remote-address-group Nov 21 13:43:48.381992 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: security_groups_shared_filtering.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.382936 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.383449 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: security-groups-shared-filtering Nov 21 13:43:48.383776 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.384650 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 21 13:43:48.384975 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: securitygroup.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.394834 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.395367 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: security-group Nov 21 13:43:48.395709 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: segment.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.396527 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.397036 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension segment not supported by any of loaded plugins Nov 21 13:43:48.397367 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.398317 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.398828 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 21 13:43:48.399159 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: servicetype.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.400318 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.400835 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: service-type Nov 21 13:43:48.401162 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: sorting.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.402169 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.402509 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: sorting Nov 21 13:43:48.402838 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: standard_attr_segment.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.404304 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.404819 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 21 13:43:48.405148 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: standardattrdescription.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.405805 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.406316 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: standard-attr-description Nov 21 13:43:48.406647 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: stateful_security_group.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.407597 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.408145 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: stateful-security-group Nov 21 13:43:48.408479 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: stdattrs_common.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.409071 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 21 13:43:48.409400 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.410347 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.410859 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 21 13:43:48.411186 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: subnet_onboard.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.412307 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.412828 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: subnet_onboard Nov 21 13:43:48.413160 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: subnet_segmentid_writable.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.414102 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.414610 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 21 13:43:48.414937 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: subnet_service_types.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.415905 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.416416 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: subnet-service-types Nov 21 13:43:48.416744 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: subnetallocation.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.417853 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.418367 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: subnet_allocation Nov 21 13:43:48.418697 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.419962 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.420471 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: subnetpool-prefix-ops Nov 21 13:43:48.420798 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.421748 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.422257 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 21 13:43:48.422583 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: tagging.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.423663 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.424204 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: standard-attr-tag Nov 21 13:43:48.424533 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: timestamp.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.425762 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.426281 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loaded extension: standard-attr-timestamp Nov 21 13:43:48.426614 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: trunk.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.427651 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.428189 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension trunk not supported by any of loaded plugins Nov 21 13:43:48.428525 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: trunk_details.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.429457 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.429968 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension trunk-details not supported by any of loaded plugins Nov 21 13:43:48.430300 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: uplink_status_propagation.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.431234 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.431747 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 21 13:43:48.432108 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Loading extension file: vlantransparent.py {{(pid=108931) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 21 13:43:48.432788 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=108931) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 21 13:43:48.433294 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extension vlan-transparent not supported by any of loaded plugins Nov 21 13:43:48.435868 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:network Nov 21 13:43:48.436417 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:subnet Nov 21 13:43:48.436825 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:subnetpool Nov 21 13:43:48.437225 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:port Nov 21 13:43:48.438466 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.438907 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service FLAVORS assigned prefix: {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.439536 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.440010 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.440356 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:router Nov 21 13:43:48.440793 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:floatingip Nov 21 13:43:48.441287 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service METERING assigned prefix: /metering {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.442725 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.443100 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.443456 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108931) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:43:48.444525 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of CountableResource for resource:rbac_policy Nov 21 13:43:48.444972 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:security_group Nov 21 13:43:48.445439 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:security_group_rule Nov 21 13:43:48.446063 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service CORE assigned prefix: {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.446407 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:subnetpool Nov 21 13:43:48.446761 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] subnetpool is already registered Nov 21 13:43:48.447192 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service CORE assigned prefix: {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.447530 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:subnetpool Nov 21 13:43:48.447898 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] subnetpool is already registered Nov 21 13:43:48.450690 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.451127 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service FLAVORS assigned prefix: {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.451722 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.452176 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.452517 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:router Nov 21 13:43:48.452861 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] router is already registered Nov 21 13:43:48.453276 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:floatingip Nov 21 13:43:48.453614 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] floatingip is already registered Nov 21 13:43:48.454074 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service METERING assigned prefix: /metering {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.454799 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of CountableResource for resource:rbac_policy Nov 21 13:43:48.455088 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] rbac_policy is already registered Nov 21 13:43:48.455506 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:security_group Nov 21 13:43:48.455874 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] security_group is already registered Nov 21 13:43:48.456285 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:security_group_rule Nov 21 13:43:48.456624 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] security_group_rule is already registered Nov 21 13:43:48.457256 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service CORE assigned prefix: {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.457588 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:subnetpool Nov 21 13:43:48.457926 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] subnetpool is already registered Nov 21 13:43:48.458349 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.v2.resource_helper [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Service CORE assigned prefix: {{(pid=108931) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 21 13:43:48.458685 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Creating instance of TrackedResource for resource:subnetpool Nov 21 13:43:48.459023 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING neutron.quota.resource_registry [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] subnetpool is already registered Nov 21 13:43:48.459489 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: extensions {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.460982 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: address-groups {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.462458 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: address-scopes {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.463793 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: agents {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.464986 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: auto-allocated-topology {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.466280 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: availability_zones {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.467487 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: dhcp-networks {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.469043 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: dhcp-agents {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.470469 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: routers {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.472728 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: flavors {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.473890 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: service_profiles {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.475096 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: next_providers {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.476583 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: service_profiles {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.478135 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: floatingip-pools {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.479350 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: routers {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.482015 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: floatingips {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.484230 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: l3-routers {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.485644 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: l3-agents {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.487060 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: metering-labels {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.488439 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: metering-label-rules {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.489734 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: network-ip-availabilities {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.490997 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: bindings {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.492679 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: quotas {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.494221 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: quotas {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.495900 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: rbac-policies {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.497738 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: security-groups {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.498968 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: security-group-rules {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.500247 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: service-providers {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.501473 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: subnetpools {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.502891 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: subnetpools {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.504383 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: tags {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.506076 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: tags {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.507923 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: tags {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.509981 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: tags {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.511777 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: tags {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.513693 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: tags {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.515368 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: tags {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.517300 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: tags {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.519084 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: tags {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.520980 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron.api.extensions [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Extended resource: tags {{(pid=108931) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 21 13:43:48.527043 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING keystonemiddleware.auth_token [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 13:43:48.531822 dv-cinder-768458-12-iscsi neutron-server[108931]: WARNING keystonemiddleware.auth_token [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 13:43:48.540450 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_concurrency.lockutils [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Acquired lock "singleton_lock" {{(pid=108931) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 21 13:43:48.540926 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_concurrency.lockutils [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Releasing lock "singleton_lock" {{(pid=108931) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 21 13:43:48.541573 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO oslo_service.service [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Starting 2 workers Nov 21 13:43:48.546898 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Started child 109040 {{(pid=108931) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 21 13:43:48.551296 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Started child 109041 {{(pid=108931) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 21 13:43:48.552471 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:43:48.553102 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO neutron.service [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Neutron service started, listening on 0.0.0.0:9696 Nov 21 13:43:48.553595 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Publish callbacks [] for process, before_spawn {{(pid=108931) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:43:48.553947 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [-] (109040) wsgi starting up on http://0.0.0.0:9696 Nov 21 13:43:48.556050 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO oslo_service.service [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Starting 1 workers Nov 21 13:43:48.556323 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:43:48.557715 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [-] (109041) wsgi starting up on http://0.0.0.0:9696 Nov 21 13:43:48.561898 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Started child 109042 {{(pid=108931) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 21 13:43:48.562473 dv-cinder-768458-12-iscsi neutron-server[108931]: INFO oslo_service.service [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Starting 1 workers Nov 21 13:43:48.566931 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.service [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] calling RpcWorker wait() {{(pid=109042) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 21 13:43:48.567475 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.service [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] returning from RpcWorker wait() {{(pid=109042) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 21 13:43:48.567547 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Started child 109043 {{(pid=108931) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 21 13:43:48.568305 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG neutron_lib.callbacks.manager [None req-b4b452ff-39b6-4f9c-b734-0e39dfeca09e None None] Publish callbacks [] for process, after_spawn {{(pid=108931) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:43:48.568961 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:43:48.569512 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:43:48.570214 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=108931) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 21 13:43:48.570427 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 21 13:43:48.570620 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 21 13:43:48.570845 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 21 13:43:48.571192 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 21 13:43:48.571380 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 21 13:43:48.571921 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.572205 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.572491 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.572581 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:43:48.573010 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.573080 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.573630 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.573737 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:43:48.573897 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.574159 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.574437 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.574675 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.574848 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.575018 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.575319 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.575573 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.575893 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.576158 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.576409 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.576652 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.576831 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.577086 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] config_source = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.577376 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.577624 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.577886 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] debug = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.578129 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.578605 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.578833 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.579075 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.579295 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.579578 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.579831 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.580090 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.580328 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.580545 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.580762 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.581009 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.581247 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.581479 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.581739 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.581952 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.582196 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.582439 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.582910 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] host = dv-cinder-768458-12-iscsi {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.583157 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.583376 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.583606 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.583881 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.584131 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.584351 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.584605 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.584865 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.585122 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.585349 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.585612 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.585861 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.586080 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_dir = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.586334 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_file = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.586502 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_options = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.586722 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.587006 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.587276 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.587476 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.587649 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.587852 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.588107 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.588274 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.588530 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.588754 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.588974 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.589191 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.589433 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.589684 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.589948 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.590192 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.590428 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.590640 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.590998 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.591239 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.591487 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.591723 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.592018 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.592260 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.592500 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.592722 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.592973 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.593195 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.593437 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.593675 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.593913 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.594162 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.594385 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.594632 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.594894 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.595123 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.595353 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.595591 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.595874 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.596105 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.596346 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.596592 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.596828 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.597072 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.597308 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.597529 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] use_journal = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.597773 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] use_json = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.597986 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.598218 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.598485 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.598704 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.598917 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.599135 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.599351 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.599603 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.600083 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.600382 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.600703 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.600956 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.601213 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.601456 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.601696 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.601943 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.602703 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.602703 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.602940 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.602940 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.603262 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.603513 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.603754 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.604103 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.604348 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.604603 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.604853 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.605111 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.605353 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.605841 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.606085 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.606938 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.607309 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.607526 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.607773 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.608121 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.608494 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.611074 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.611074 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.611074 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.11/identity {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.611074 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.611074 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.611074 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.611074 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.611074 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.613714 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.613714 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.613714 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.613714 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.613714 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.613714 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.613714 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.613714 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.613714 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.614856 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.614856 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.614856 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.614856 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.614856 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.614856 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.614856 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.614856 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.614856 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.617469 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.617469 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.617469 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.617469 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.617469 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.617469 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.617469 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.617469 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.617469 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.621083 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.621083 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.621083 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.621083 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.621083 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.621083 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.621083 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.621083 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.621083 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.622712 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.622712 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.622712 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.622712 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.622712 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.622712 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.622712 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.622712 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.622712 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.624976 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.624976 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.624976 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.624976 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.624976 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.624976 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.624976 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.624976 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.624976 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.625777 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.625777 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.625777 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.625777 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.625777 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.625777 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.625777 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.626693 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.626693 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.626693 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.626693 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.629183 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.629183 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.629183 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.629183 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.629183 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.629183 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.629183 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.629183 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.630086 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.630086 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.630086 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.630086 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.630086 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.630086 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.630628 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.630628 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.630628 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.630850 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.631111 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.631356 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.631644 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.631972 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.632455 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.632928 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.633342 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.633785 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.634490 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.634924 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.635347 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.635727 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.636162 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.636413 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.636673 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.636927 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.637167 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.637407 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.637774 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.638023 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.638278 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.638514 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.638779 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.639028 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.639270 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.639556 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.639831 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.640112 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.640369 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.640599 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.11/identity {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.640816 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.641058 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.641303 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.641521 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.641743 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.641979 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.642219 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.642453 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.642673 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.642924 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.643144 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.643368 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.643625 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.643888 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.644113 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.644370 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.644586 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.644812 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.645058 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.645300 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.645521 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.645765 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.645996 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.646251 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.646473 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.646745 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.647003 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.647240 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.647488 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.647715 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.647996 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.648218 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.648527 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.648700 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.648945 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.649167 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.649392 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.649609 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.649846 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.650095 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.650310 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.650555 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.650906 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.651399 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.651661 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.651927 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.652173 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.652397 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.652633 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.653040 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.653426 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.653796 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.654172 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.654555 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.655005 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.655259 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.655521 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.655742 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.655997 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.656236 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.656460 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.656677 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.656973 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.657238 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.657464 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.657725 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.657948 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.658183 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.658435 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.658650 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.658863 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.659087 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.659307 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.659521 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.659751 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.659990 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.660204 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.660427 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.660647 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.660901 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.661138 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.661357 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.661569 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.661796 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.662016 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.662225 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.662452 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.662665 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.662880 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.663102 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.663325 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.663550 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.663776 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.664017 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.664230 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.664452 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.664673 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.664886 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.665200 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.665456 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.665676 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.665973 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.666202 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.666454 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.666724 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.667023 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.667238 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.667478 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.667733 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.667978 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.668201 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.668457 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.668779 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.669606 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.669866 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.670122 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.670406 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.670697 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:500:549'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.670966 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.671185 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.671488 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.671831 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.672111 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.672395 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.672629 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.672892 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.673114 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.673333 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.673572 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.673816 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.674072 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.674315 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.674566 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.674813 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.675032 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.675286 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.675505 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.675737 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.675994 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.676220 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.676459 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.676619 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 21 13:43:48.677140 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=108931) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 21 13:43:48.677302 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 21 13:43:48.677457 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 21 13:43:48.677630 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 21 13:43:48.677802 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 21 13:43:48.677955 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 21 13:43:48.678164 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.678327 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.678489 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.678651 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.678812 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.678995 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.679159 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.679319 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.679480 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.679642 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.679827 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.679989 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.680151 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.680311 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.680472 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.680632 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.680793 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.680953 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.681116 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.681278 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] config_source = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.681439 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.681653 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.681779 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] debug = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.681900 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.682096 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.682250 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.682511 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.682677 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.682838 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.683015 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.683147 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.683306 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.683466 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.683625 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.683785 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.683975 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.684137 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.684298 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.684459 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.684667 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.684829 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.684990 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] host = dv-cinder-768458-12-iscsi {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.685150 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.685310 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.685470 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.685630 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.685790 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.685952 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.686128 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.686259 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.686419 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.686580 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.686740 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.686903 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.687067 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_dir = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.687227 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_file = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.687389 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_options = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.687551 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.687712 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.687904 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.688093 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.688283 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.688415 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.688576 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.688738 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.688899 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.689060 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.689221 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.689382 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.689543 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.689705 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.689866 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.690026 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.690187 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.690348 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.690510 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.690670 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.690830 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.690989 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.691151 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.691311 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.691472 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.691688 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.691854 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.691953 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.692109 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.692270 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.692431 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.692593 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.692755 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.692916 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.693077 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.693238 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.693399 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.693559 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.693724 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.693885 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.694050 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.694211 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.694372 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.694534 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.694698 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.694858 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] use_journal = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.695176 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] use_json = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.695337 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.695499 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.695659 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.695854 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.696008 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.696318 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.696480 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.696643 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 13:43:48.696825 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.697066 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.697204 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.697326 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.697468 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.697630 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.697793 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.697956 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.698119 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.698282 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.698452 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.698617 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.698789 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.698953 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.699116 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.699280 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.699443 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.699607 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.699770 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.699959 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.700642 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.700828 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.701000 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.701164 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.701326 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.701487 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.701651 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.701828 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.701993 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.702172 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.702336 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.702502 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.11/identity {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.702665 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.702829 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.702995 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.703161 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.703326 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.703490 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.703656 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.703838 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.704024 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.704161 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.704318 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.704487 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.704647 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:43:48.704777 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.704922 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.705013 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.705112 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.705275 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.705440 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.705606 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.705770 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.705933 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.706098 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.706262 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.706426 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.706589 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.706763 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.706928 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.707108 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.707259 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.707423 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.707587 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.707751 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.707946 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.708111 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.708276 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.708440 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.708617 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.708780 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.708944 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.709107 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.709272 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.709437 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.709601 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.709764 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.709928 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.710091 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.710256 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.710421 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.710585 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.710748 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.710906 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.711064 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.711228 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.711390 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.711555 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.711718 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.711906 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.712071 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.712242 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.712409 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.712585 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.712749 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.712913 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.713076 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.713238 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.713401 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.713569 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.713729 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.713891 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.714055 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.714218 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.714379 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.714548 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.714702 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.714866 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.715020 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.715168 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.715329 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.715481 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.715627 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.715839 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.715991 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.716158 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.716321 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.716507 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.716651 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.716804 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.716968 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.717136 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.717288 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.717458 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.717631 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.717796 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.717960 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.718125 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.718288 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.718452 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.718614 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.718777 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.718928 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.719091 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.719254 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.719428 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.719590 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.719754 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.719940 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.720127 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.720290 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.720455 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.720618 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.720782 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.720945 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.721108 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.721271 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.721435 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.721597 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.721763 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.721927 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.11/identity {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.722098 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.722250 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.722413 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.722577 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.722741 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.722903 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.723066 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.723231 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.723395 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.723557 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.723721 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.723916 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.724080 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.724242 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.724409 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.724573 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.724738 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.724901 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.725064 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.725227 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.725390 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.725554 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.725718 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.725882 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.726044 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.726218 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.726372 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.726535 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.726698 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.726862 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.727027 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.727190 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.727356 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.727520 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.727685 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.727868 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.728034 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.728198 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.728362 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.728527 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.728690 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.728854 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.729017 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.729194 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.729358 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.729520 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.729685 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.729848 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.730012 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.730174 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.730337 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.730499 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.730662 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.730825 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.730991 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.731158 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.731322 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.732040 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.732205 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.732370 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.732533 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.732698 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.732874 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.733038 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.733202 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.733365 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.733530 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.733693 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.733866 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.734029 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.734194 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.734357 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.734521 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.734685 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.734859 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.735027 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.735190 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.735352 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.735516 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.735680 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.735874 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.736038 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.736203 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.736367 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.736530 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.736693 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.736866 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.737030 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.737193 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.737357 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.737521 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.737689 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.737894 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.738037 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.738170 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.738325 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.738489 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.738653 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.738826 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.738992 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.739156 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.739327 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.739490 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.739653 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.739825 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.740012 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.740177 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.740343 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.740508 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.740670 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.740834 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.741000 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.741169 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.741340 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.741510 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.741676 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.741852 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.742000 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:500:549'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.742177 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.742342 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.742512 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.742685 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.742833 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.743005 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.743153 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.743290 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.743453 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.743618 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.743781 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.743971 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.744119 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.744254 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.744415 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.744568 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.744905 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.745197 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.745367 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.745532 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.745696 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.745861 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.746026 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 13:43:48.746184 dv-cinder-768458-12-iscsi neutron-server[108931]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 21 13:43:48.905640 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 47124) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:43:48.914034 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [-] 10.222.0.11 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0062468 Nov 21 13:44:00.215139 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1b4a475-0c8e-417d-81e3-1ac9af87ec90 None None] get_active_networks_info from dv-cinder-768458-12-iscsi {{(pid=109042) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 21 13:44:00.272266 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1b4a475-0c8e-417d-81e3-1ac9af87ec90 None None] No non-hosted networks {{(pid=109042) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 21 13:44:00.283213 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.agentschedulers_db [None req-f1b4a475-0c8e-417d-81e3-1ac9af87ec90 None None] DHCP Agent not found on host dv-cinder-768458-12-iscsi {{(pid=109042) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 21 13:44:00.441173 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-47d34dd0-f728-4580-a49a-f4926a7442c1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-473098'] for agent, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:02.522583 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-082d766a-e292-4e35-8dca-ffbedcbce112 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-473098'] for agent, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:02.564284 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-32017904-15a0-4cfc-9764-4eb5fa03841e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:03.892341 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-473098'] for agent, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:05.071648 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-473098'] for agent, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:05.945524 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-473098'] for agent, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:05.946645 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:05.947232 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:05.947833 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:05.948377 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:05.949018 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:05.949582 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:05.950646 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:05.951178 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:05.951719 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:05.952644 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:05.953443 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:05.954243 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:05.954865 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-768458-12-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:44:05.962009 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-768458-12-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:44:06.310872 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.db.l3_hamode_db [None req-e82778c2-780d-42a8-8623-73d13d64e2a9 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 21 13:44:06.384893 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e82778c2-780d-42a8-8623-73d13d64e2a9 None None] Routers set() bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:44:06.385283 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e82778c2-780d-42a8-8623-73d13d64e2a9 None None] Router IDs set() for agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 21 13:44:06.571852 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 47214) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:44:07.064516 dv-cinder-768458-12-iscsi neutron-server[109040]: WARNING oslo_policy.policy [None req-182f7dd6-80f6-4533-9497-e28a25b7f400 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 21 13:44:07.065364 dv-cinder-768458-12-iscsi neutron-server[109040]: WARNING oslo_policy.policy [None req-182f7dd6-80f6-4533-9497-e28a25b7f400 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 21 13:44:07.298459 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [None req-182f7dd6-80f6-4533-9497-e28a25b7f400 admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109040) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 13:44:07.299568 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-182f7dd6-80f6-4533-9497-e28a25b7f400 admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7267988 Nov 21 13:44:09.752388 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47230) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:44:10.258416 dv-cinder-768458-12-iscsi neutron-server[109041]: WARNING oslo_policy.policy [None req-a71c99d4-8c3d-4171-9364-d3d81e39be75 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 21 13:44:10.259271 dv-cinder-768458-12-iscsi neutron-server[109041]: WARNING oslo_policy.policy [None req-a71c99d4-8c3d-4171-9364-d3d81e39be75 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 21 13:44:10.489787 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-a71c99d4-8c3d-4171-9364-d3d81e39be75 admin admin] Request body: {'subnetpool': {'default_prefixlen': 26, 'prefixes': ['172.20.0.0/16'], 'is_default': True, 'name': 'shared-default-subnetpool-v4', 'shared': True}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:44:10.586775 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.policy [None req-a71c99d4-8c3d-4171-9364-d3d81e39be75 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=109041) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 21 13:44:10.634580 dv-cinder-768458-12-iscsi neutron-server[109041]: WARNING oslo_policy.policy [None req-a71c99d4-8c3d-4171-9364-d3d81e39be75 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 21 13:44:10.634948 dv-cinder-768458-12-iscsi neutron-server[109041]: WARNING oslo_policy.policy [None req-a71c99d4-8c3d-4171-9364-d3d81e39be75 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 21 13:44:10.643356 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.quota [None req-a71c99d4-8c3d-4171-9364-d3d81e39be75 admin admin] Loaded quota_driver: . Nov 21 13:44:10.730180 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a71c99d4-8c3d-4171-9364-d3d81e39be75 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8730999433906', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8730999432263', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8730999421205', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8730999419406', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8730999393263', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8730999399623', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1317247', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1353056', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-357826', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-672615'] for rbac-policy, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:10.795568 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a71c99d4-8c3d-4171-9364-d3d81e39be75 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:10.796958 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-a71c99d4-8c3d-4171-9364-d3d81e39be75 admin admin] 10.222.0.11 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 1.0425029 Nov 21 13:44:13.463714 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 47248) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:44:13.753434 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Request body: {'network': {'project_id': '272d0fee05e248aba40a29566e203eaf', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'name': 'private', 'admin_state_up': True}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:44:13.754850 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.quota [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Loaded quota_driver: . Nov 21 13:44:13.810255 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Made reservation on behalf of 272d0fee05e248aba40a29566e203eaf for: {'network': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:44:13.884196 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.policy [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=109040) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 21 13:44:13.954390 dv-cinder-768458-12-iscsi neutron-server[109040]: WARNING oslo_policy.policy [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 21 13:44:13.954923 dv-cinder-768458-12-iscsi neutron-server[109040]: WARNING oslo_policy.policy [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 21 13:44:13.966502 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:13.986899 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:14.096645 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:14.100345 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:14.120358 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] vlan segment allocate from pool success with {'vlan_id': 543, 'physical_network': 'physnet1'} {{(pid=109040) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:44:14.150476 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8731000399580', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:14.151008 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Unsubscribe: segment precommit_create {{(pid=109040) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 21 13:44:14.151545 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.segments_db [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Added segment b05f5d43-d878-4233-882c-c327afc320d8 of type vlan for network e11c0253-9b2e-438c-a8c8-d25bc94867d5 Nov 21 13:44:14.167267 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb0f01a8-6f5d-4c0a-9b4c-e1bbbdf36525,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:14.218495 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:14.218856 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:14.219205 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:14.219535 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:14.219893 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:14.220242 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:14.220573 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:14.220914 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:14.221245 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:14.221569 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:14.221893 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:14.222212 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Tracked resource versions report: Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: pushed versions: Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: { 'AddressGroup': {'1.2'}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'ConntrackHelper': {'1.0'}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Log': {'1.0'}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Network': {'1.1'}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Port': {'1.7'}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'PortForwarding': {'1.2'}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'QosPolicy': {'1.10'}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'SecurityGroup': {'1.5'}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'SecurityGroupRule': {'1.2'}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'SubPort': {'1.0'}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Subnet': {'1.1'}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Trunk': {'1.1'}} Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: consumer versions: Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: { DHCP agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: L3 agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: Metadata agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: Metering agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: Open vSwitch agent@dv-cinder-768458-12-iscsi: { 'AddressGroup': '1.2', Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'ConntrackHelper': '1.0', Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Log': '1.0', Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Network': '1.1', Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Port': '1.7', Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'PortForwarding': '1.2', Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'QosPolicy': '1.10', Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'SecurityGroup': '1.5', Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'SecurityGroupRule': '1.2', Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'SubPort': '1.0', Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Subnet': '1.1', Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Trunk': '1.1'}} Nov 21 13:44:14.223577 dv-cinder-768458-12-iscsi neutron-server[109040]: {{(pid=109040) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 21 13:44:14.276873 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:14.330578 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:14.331633 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:44:14.332423 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:14.411227 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.9463427 Nov 21 13:44:14.437966 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7680e111-a37f-4153-899d-ee8efd7664d4 admin admin] Pushing event updated for resources: {'Network': ['ID=e11c0253-9b2e-438c-a8c8-d25bc94867d5,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:14.450301 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network e11c0253-9b2e-438c-a8c8-d25bc94867d5 details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:44:17.151135 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 47264) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:44:17.539941 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8043d855-9a36-4b69-8c0b-5584c873eb77 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:44:17.541332 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-8043d855-9a36-4b69-8c0b-5584c873eb77 admin admin] 10.222.0.11 "GET /v2.0/networks/e11c0253-9b2e-438c-a8c8-d25bc94867d5 HTTP/1.1" status: 200 len: 825 time: 0.3892488 Nov 21 13:44:17.583211 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-47487d66-d64a-47bb-9941-a554dcfbbaa6 admin admin] 10.222.0.11 "GET /v2.0/subnetpools/cc0186fa-86db-4358-82eb-ef697718e90d HTTP/1.1" status: 200 len: 734 time: 0.0355668 Nov 21 13:44:17.593464 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-ace51b8d-de3c-42f4-bb26-59f9d629f4e2 admin admin] Request body: {'subnet': {'name': 'private-subnet', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'subnetpool_id': 'cc0186fa-86db-4358-82eb-ef697718e90d', 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:44:17.615128 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ace51b8d-de3c-42f4-bb26-59f9d629f4e2 admin admin] Made reservation on behalf of 272d0fee05e248aba40a29566e203eaf for: {'subnet': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:44:17.617312 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ace51b8d-de3c-42f4-bb26-59f9d629f4e2 admin admin] Publish callbacks [] for subnet, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:17.904857 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ace51b8d-de3c-42f4-bb26-59f9d629f4e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for subnet, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:17.971598 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ace51b8d-de3c-42f4-bb26-59f9d629f4e2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f497c47a-25e3-40c0-839e-9b5cf222fe03,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:17.976257 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ace51b8d-de3c-42f4-bb26-59f9d629f4e2 admin admin] Checking segment: {'id': 'b05f5d43-d878-4233-882c-c327afc320d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109040) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:44:17.976659 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ace51b8d-de3c-42f4-bb26-59f9d629f4e2 admin admin] Network hostable DHCP agents. Network: e11c0253-9b2e-438c-a8c8-d25bc94867d5, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109040) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:44:17.996484 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ace51b8d-de3c-42f4-bb26-59f9d629f4e2 admin admin] Network e11c0253-9b2e-438c-a8c8-d25bc94867d5 is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109040) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:44:18.006955 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-ace51b8d-de3c-42f4-bb26-59f9d629f4e2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, e11c0253-9b2e-438c-a8c8-d25bc94867d5) {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:44:18.012388 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ace51b8d-de3c-42f4-bb26-59f9d629f4e2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:44:18.012986 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ace51b8d-de3c-42f4-bb26-59f9d629f4e2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:18.017174 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-274f806e-5b54-4365-a1f4-9bee18fb5eef None None] Network e11c0253-9b2e-438c-a8c8-d25bc94867d5 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:44:18.029458 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-ace51b8d-de3c-42f4-bb26-59f9d629f4e2 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4401143 Nov 21 13:44:18.341794 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6b3ed262-49ce-5e18-b10a-0ddd25bea067-e11c0253-9b2e-438c-a8c8-d25bc94867d5', 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'fixed_ips': [{'subnet_id': 'f497c47a-25e3-40c0-839e-9b5cf222fe03'}]}} from dv-cinder-768458-12-iscsi. {{(pid=109042) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 21 13:44:18.343046 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:18.630829 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.db_base_plugin_common [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Allocated IP 172.20.0.2 (e11c0253-9b2e-438c-a8c8-d25bc94867d5/f497c47a-25e3-40c0-839e-9b5cf222fe03/631357b8-a8c7-4caa-abba-3372e2bf82cb) {{(pid=109042) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:44:18.829481 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Publish callbacks [] for port, precommit_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:18.837175 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:18.911266 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Network e11c0253-9b2e-438c-a8c8-d25bc94867d5 is already hosted by enough agents. {{(pid=109042) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:44:18.919548 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.base_scheduler [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Resources bound (agent type, host, resource id): {{(pid=109042) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:44:18.924913 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Pushing event updated for resources: {'Port': ['ID=631357b8-a8c7-4caa-abba-3372e2bf82cb,revision_number=1']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:18.927107 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Received port after_create {{(pid=109042) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:44:18.937241 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:18.937611 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:18.937959 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:18.938299 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:18.938639 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:18.938992 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:18.939330 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:18.939658 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:18.940022 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:18.940352 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:18.940676 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:18.940999 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Tracked resource versions report: Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: pushed versions: Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: { 'AddressGroup': {'1.2'}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'ConntrackHelper': {'1.0'}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Log': {'1.0'}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Network': {'1.1'}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Port': {'1.7'}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'PortForwarding': {'1.2'}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'QosPolicy': {'1.10'}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'SecurityGroup': {'1.5'}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'SecurityGroupRule': {'1.2'}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'SubPort': {'1.0'}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Subnet': {'1.1'}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Trunk': {'1.1'}} Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: consumer versions: Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: { DHCP agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: L3 agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: Metadata agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: Metering agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: Open vSwitch agent@dv-cinder-768458-12-iscsi: { 'AddressGroup': '1.2', Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'ConntrackHelper': '1.0', Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Log': '1.0', Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Network': '1.1', Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Port': '1.7', Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'PortForwarding': '1.2', Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'QosPolicy': '1.10', Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'SecurityGroup': '1.5', Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'SecurityGroupRule': '1.2', Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'SubPort': '1.0', Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Subnet': '1.1', Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Trunk': '1.1'}} Nov 21 13:44:18.942353 dv-cinder-768458-12-iscsi neutron-server[109042]: {{(pid=109042) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 21 13:44:19.015615 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Attempting to bind port 631357b8-a8c7-4caa-abba-3372e2bf82cb on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:44:19.016039 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Attempting to bind port 631357b8-a8c7-4caa-abba-3372e2bf82cb by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': 'b05f5d43-d878-4233-882c-c327afc320d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:44:19.016462 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Attempting to bind port 631357b8-a8c7-4caa-abba-3372e2bf82cb on network e11c0253-9b2e-438c-a8c8-d25bc94867d5 {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:44:19.021371 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 44, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:44:19.021955 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Checking segment: {'id': 'b05f5d43-d878-4233-882c-c327afc320d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:44:19.022207 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:19.022596 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Bound using segment: {'id': 'b05f5d43-d878-4233-882c-c327afc320d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:44:19.023078 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Bound port: 631357b8-a8c7-4caa-abba-3372e2bf82cb, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b05f5d43-d878-4233-882c-c327afc320d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:44:19.023485 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:19.083500 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] For port 631357b8-a8c7-4caa-abba-3372e2bf82cb, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:44:19.104790 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] For port 631357b8-a8c7-4caa-abba-3372e2bf82cb, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=631357b8-a8c7-4caa-abba-3372e2bf82cb,segment=NetworkSegment(b05f5d43-d878-4233-882c-c327afc320d8),segment_id=b05f5d43-d878-4233-882c-c327afc320d8)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:44:19.109332 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:19.164278 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ac0b820-0f19-4d24-8618-8191d67e1cba None None] Pushing event updated for resources: {'Port': ['ID=631357b8-a8c7-4caa-abba-3372e2bf82cb,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:20.539074 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 47272) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:44:20.848641 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [None req-75c358b0-3bae-4a58-84ad-c1b429c63f1b admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109040) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 13:44:20.849714 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-75c358b0-3bae-4a58-84ad-c1b429c63f1b admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3097429 Nov 21 13:44:23.385867 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 47280) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:44:23.697084 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [None req-3bec719c-4755-4c00-a0e3-c7c11c93d3d7 admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109040) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 13:44:23.698163 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-3bec719c-4755-4c00-a0e3-c7c11c93d3d7 admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3113699 Nov 21 13:44:26.423098 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 47290) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:44:26.718552 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-d5403a91-6a0c-47b8-b6e3-f42be169e9dc admin admin] Request body: {'router': {'name': 'router1', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'admin_state_up': True}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:44:26.741780 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d5403a91-6a0c-47b8-b6e3-f42be169e9dc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-408660', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-58304'] for router, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:26.743342 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d5403a91-6a0c-47b8-b6e3-f42be169e9dc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-473172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-468334', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1610115', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-58419'] for router, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:26.881172 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d5403a91-6a0c-47b8-b6e3-f42be169e9dc admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:26.887297 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d5403a91-6a0c-47b8-b6e3-f42be169e9dc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-473263', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-468275'] for router, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:26.902195 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d5403a91-6a0c-47b8-b6e3-f42be169e9dc admin admin] Publish callbacks [] for router, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:26.903549 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-d5403a91-6a0c-47b8-b6e3-f42be169e9dc admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.4794779 Nov 21 13:44:27.687949 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 631357b8-a8c7-4caa-abba-3372e2bf82cb up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:44:27.777226 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 631357b8-a8c7-4caa-abba-3372e2bf82cb triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:44:27.777841 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:27.884624 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:27.917794 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port 631357b8-a8c7-4caa-abba-3372e2bf82cb, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=631357b8-a8c7-4caa-abba-3372e2bf82cb,segment=NetworkSegment(b05f5d43-d878-4233-882c-c327afc320d8),segment_id=b05f5d43-d878-4233-882c-c327afc320d8)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:44:27.922214 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:27.969310 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=631357b8-a8c7-4caa-abba-3372e2bf82cb,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:28.125402 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9d769ed-7941-4ea5-bee7-cbb7da70c67a None None] Network e11c0253-9b2e-438c-a8c8-d25bc94867d5 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:44:28.185880 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-7dfcedbc-f757-4959-8b79-3c4d67dbd5f3 None None] Provisioning complete for port 631357b8-a8c7-4caa-abba-3372e2bf82cb triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:44:28.186168 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-7dfcedbc-f757-4959-8b79-3c4d67dbd5f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:28.549888 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-8977a11e-ba3f-42d3-a33c-c8fbb166cc9b None None] Provisioning complete for port 631357b8-a8c7-4caa-abba-3372e2bf82cb triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:44:28.550263 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8977a11e-ba3f-42d3-a33c-c8fbb166cc9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:29.408484 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47302) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:44:29.656045 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 631357b8-a8c7-4caa-abba-3372e2bf82cb up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:44:29.707344 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 631357b8-a8c7-4caa-abba-3372e2bf82cb triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:44:29.707715 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:29.727770 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [None req-3d4d9fc0-1db2-4755-b9bb-d9307441404f admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109041) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 13:44:29.728792 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-3d4d9fc0-1db2-4755-b9bb-d9307441404f admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3193183 Nov 21 13:44:30.124327 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-edd5d4a5-cd2f-4ff5-bc37-7c58a770adc7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:32.195777 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47310) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:44:32.500340 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Request body: {'network': {'is_default': True, 'provider:network_type': 'flat', 'provider:physical_network': 'physnet1', 'name': 'public', 'admin_state_up': True, 'router:external': True}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:44:32.517953 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-83f8f433-0ee0-4a4b-9bfd-a062afc7913b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:32.530302 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Made reservation on behalf of a8cf82ee5982490d8c74cb5553b021ce for: {'network': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:44:32.533108 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:32.548912 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:32.656785 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:32.660641 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:32.672645 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Reserving flat network on physical network physnet1 {{(pid=109041) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 21 13:44:32.705415 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8731000399580', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:32.706000 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Unsubscribe: segment precommit_create {{(pid=109041) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 21 13:44:32.706497 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.segments_db [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Added segment 0c0e7cfc-5b14-4551-b79a-294ec69a8c15 of type flat for network 67069811-a3d5-4953-8a57-e62d44750fe3 Nov 21 13:44:32.722239 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=530f83f8-5394-478f-9a81-2f1c173ad837,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:32.748128 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:32.748484 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:32.748818 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:32.749148 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:32.749470 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:32.749802 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:32.750133 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:32.750460 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:32.750782 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:32.751098 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:32.751410 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:32.751720 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Tracked resource versions report: Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: pushed versions: Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: { 'AddressGroup': {'1.2'}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'ConntrackHelper': {'1.0'}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Log': {'1.0'}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Network': {'1.1'}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Port': {'1.7'}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'PortForwarding': {'1.2'}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'QosPolicy': {'1.10'}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'SecurityGroup': {'1.5'}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'SecurityGroupRule': {'1.2'}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'SubPort': {'1.0'}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Subnet': {'1.1'}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Trunk': {'1.1'}} Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: consumer versions: Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: { DHCP agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: L3 agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: Metadata agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: Metering agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: Open vSwitch agent@dv-cinder-768458-12-iscsi: { 'AddressGroup': '1.2', Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'ConntrackHelper': '1.0', Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Log': '1.0', Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Network': '1.1', Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Port': '1.7', Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'PortForwarding': '1.2', Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'QosPolicy': '1.10', Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'SecurityGroup': '1.5', Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'SecurityGroupRule': '1.2', Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'SubPort': '1.0', Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Subnet': '1.1', Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Trunk': '1.1'}} Nov 21 13:44:32.753090 dv-cinder-768458-12-iscsi neutron-server[109041]: {{(pid=109041) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 21 13:44:32.840475 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:32.883912 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:32.885082 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:44:32.885841 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:32.968645 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.7717538 Nov 21 13:44:32.994908 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-877eda81-7aea-4691-b572-bc7deda8aeff admin admin] Pushing event updated for resources: {'Network': ['ID=67069811-a3d5-4953-8a57-e62d44750fe3,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:33.006378 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 67069811-a3d5-4953-8a57-e62d44750fe3 details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:44:33.794754 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:35.024280 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:35.433866 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47332) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:44:35.649400 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a552d6e7-684c-4b0f-add2-607a4ca1af7a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:44:35.650794 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-a552d6e7-684c-4b0f-add2-607a4ca1af7a admin admin] 10.222.0.11 "GET /v2.0/subnets/f497c47a-25e3-40c0-839e-9b5cf222fe03 HTTP/1.1" status: 200 len: 849 time: 0.2159722 Nov 21 13:44:35.806417 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:35.826169 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-0b73a8e9-3ed6-434a-ad03-0e65888160e9 admin admin] 10.222.0.11 "GET /v2.0/routers/55a0ca88-eab8-48f4-ba27-52a84ac9983c HTTP/1.1" status: 200 len: 704 time: 0.1688147 Nov 21 13:44:36.083062 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:36.369683 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Allocated IP 172.20.0.1 (e11c0253-9b2e-438c-a8c8-d25bc94867d5/f497c47a-25e3-40c0-839e-9b5cf222fe03/eff181be-ae57-4e97-ba55-bdbbf58007bd) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:44:36.548766 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:36.612081 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:36.684673 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Network e11c0253-9b2e-438c-a8c8-d25bc94867d5 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:44:36.689216 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:44:36.698731 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:44:36.699841 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-470894'] for router_interface, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:36.755126 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Pushing event updated for resources: {'Port': ['ID=eff181be-ae57-4e97-ba55-bdbbf58007bd,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:36.891546 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-04b83ab1-2328-4229-8c6d-13acf514bb26 None None] Provisioning complete for port eff181be-ae57-4e97-ba55-bdbbf58007bd triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:44:36.892170 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-04b83ab1-2328-4229-8c6d-13acf514bb26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:36.900711 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:36.931594 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-04b83ab1-2328-4229-8c6d-13acf514bb26 None None] Port eff181be-ae57-4e97-ba55-bdbbf58007bd cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:44:37.160086 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:37.164171 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:37.164893 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1684480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-473342'] for router_interface, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:37.239697 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Pushing event updated for resources: {'Port': ['ID=eff181be-ae57-4e97-ba55-bdbbf58007bd,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:37.290303 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Network e11c0253-9b2e-438c-a8c8-d25bc94867d5 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:44:37.291640 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:44:37.453062 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Router 55a0ca88-eab8-48f4-ba27-52a84ac9983c is scheduled to L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 with binding_index 1 {{(pid=109041) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 21 13:44:37.455267 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-044b3c7d-bf9d-460e-989e-8e67fa81857f None None] Provisioning complete for port eff181be-ae57-4e97-ba55-bdbbf58007bd triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:44:37.455646 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-044b3c7d-bf9d-460e-989e-8e67fa81857f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:37.490756 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-044b3c7d-bf9d-460e-989e-8e67fa81857f None None] Port eff181be-ae57-4e97-ba55-bdbbf58007bd cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:44:37.542354 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:44:37.547590 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-a8e0b6dc-43d5-4597-8633-8c27efd93328 admin admin] 10.222.0.11 "PUT /v2.0/routers/55a0ca88-eab8-48f4-ba27-52a84ac9983c/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.7156694 Nov 21 13:44:37.563528 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Sync routers for ids ['55a0ca88-eab8-48f4-ba27-52a84ac9983c'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:44:37.576569 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Routers {'55a0ca88-eab8-48f4-ba27-52a84ac9983c'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:44:37.577370 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:44:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['55a0ca88-eab8-48f4-ba27-52a84ac9983c'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:44:37.762571 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Set router 55a0ca88-eab8-48f4-ba27-52a84ac9983c gateway port host: None {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:44:38.186054 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'name': 'router1', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:44:26Z', 'updated_at': '2021-11-21T13:44:36Z', 'revision_number': 2, 'project_id': '272d0fee05e248aba40a29566e203eaf', 'gw_port_host': None, '_interfaces': [{'id': 'eff181be-ae57-4e97-ba55-bdbbf58007bd', 'name': '', 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'mac_address': 'fa:16:3e:fc:1b:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f497c47a-25e3-40c0-839e-9b5cf222fe03', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:44:36Z', 'updated_at': '2021-11-21T13:44:37Z', 'revision_number': 2, 'project_id': '272d0fee05e248aba40a29566e203eaf', 'subnets': [{'id': 'f497c47a-25e3-40c0-839e-9b5cf222fe03', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'cc0186fa-86db-4358-82eb-ef697718e90d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:44:38.235352 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Checking router: 55a0ca88-eab8-48f4-ba27-52a84ac9983c for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:44:38.235720 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Updating router 55a0ca88-eab8-48f4-ba27-52a84ac9983c port eff181be-ae57-4e97-ba55-bdbbf58007bd binding host dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:44:38.283705 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:38.794266 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Publish callbacks [] for port, precommit_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:38.800318 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:38.962477 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Attempting to bind port eff181be-ae57-4e97-ba55-bdbbf58007bd on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:44:38.962879 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Attempting to bind port eff181be-ae57-4e97-ba55-bdbbf58007bd by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': 'b05f5d43-d878-4233-882c-c327afc320d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5'}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:44:38.963325 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Attempting to bind port eff181be-ae57-4e97-ba55-bdbbf58007bd on network e11c0253-9b2e-438c-a8c8-d25bc94867d5 {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:44:38.965940 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Pushing event updated for resources: {'Port': ['ID=eff181be-ae57-4e97-ba55-bdbbf58007bd,revision_number=3']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:38.975704 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 44, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:44:38.976132 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Checking segment: {'id': 'b05f5d43-d878-4233-882c-c327afc320d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109043) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:44:38.976603 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:38.976993 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Bound using segment: {'id': 'b05f5d43-d878-4233-882c-c327afc320d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5'} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:44:38.977480 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Bound port: eff181be-ae57-4e97-ba55-bdbbf58007bd, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b05f5d43-d878-4233-882c-c327afc320d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 543, 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5'}}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:44:38.977869 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:38.981093 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:38.981443 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:38.981779 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:38.982107 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:38.982432 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:38.982762 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:38.983089 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:38.983413 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:38.983748 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:38.984092 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:38.984409 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:38.984723 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Tracked resource versions report: Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: pushed versions: Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: { 'AddressGroup': {'1.2'}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'ConntrackHelper': {'1.0'}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Log': {'1.0'}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Network': {'1.1'}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Port': {'1.7'}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'PortForwarding': {'1.2'}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'QosPolicy': {'1.10'}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'SecurityGroup': {'1.5'}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'SecurityGroupRule': {'1.2'}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'SubPort': {'1.0'}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Subnet': {'1.1'}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Trunk': {'1.1'}} Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: consumer versions: Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: { DHCP agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: L3 agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: Metadata agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: Metering agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: Open vSwitch agent@dv-cinder-768458-12-iscsi: { 'AddressGroup': '1.2', Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'ConntrackHelper': '1.0', Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Log': '1.0', Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Network': '1.1', Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Port': '1.7', Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'PortForwarding': '1.2', Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'QosPolicy': '1.10', Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'SecurityGroup': '1.5', Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'SecurityGroupRule': '1.2', Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'SubPort': '1.0', Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Subnet': '1.1', Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Trunk': '1.1'}} Nov 21 13:44:38.986065 dv-cinder-768458-12-iscsi neutron-server[109043]: {{(pid=109043) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 21 13:44:39.018316 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-8f92a693-e17e-4a2b-91ea-37f044893e28 None None] Provisioning complete for port eff181be-ae57-4e97-ba55-bdbbf58007bd triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:44:39.019268 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8f92a693-e17e-4a2b-91ea-37f044893e28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:39.053817 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-8f92a693-e17e-4a2b-91ea-37f044893e28 None None] Port eff181be-ae57-4e97-ba55-bdbbf58007bd cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:44:39.057923 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] For port eff181be-ae57-4e97-ba55-bdbbf58007bd, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109043) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:44:39.078188 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] For port eff181be-ae57-4e97-ba55-bdbbf58007bd, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=eff181be-ae57-4e97-ba55-bdbbf58007bd,segment=NetworkSegment(b05f5d43-d878-4233-882c-c327afc320d8),segment_id=b05f5d43-d878-4233-882c-c327afc320d8)] {{(pid=109043) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:44:39.082484 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:39.135147 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Routers {'55a0ca88-eab8-48f4-ba27-52a84ac9983c'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:44:39.135758 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:44:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['55a0ca88-eab8-48f4-ba27-52a84ac9983c'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:44:39.208567 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59aa6a38-9439-4fef-ae2a-88ed40d45c98 None None] Pushing event updated for resources: {'Port': ['ID=eff181be-ae57-4e97-ba55-bdbbf58007bd,revision_number=4']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:39.226769 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] Set router 55a0ca88-eab8-48f4-ba27-52a84ac9983c gateway port host: None {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:44:39.274166 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-d05827f7-272c-4e0f-bfe0-71aed9a8acbe None None] Provisioning complete for port eff181be-ae57-4e97-ba55-bdbbf58007bd triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:44:39.274538 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d05827f7-272c-4e0f-bfe0-71aed9a8acbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:39.354599 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d05827f7-272c-4e0f-bfe0-71aed9a8acbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:39.385591 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-d05827f7-272c-4e0f-bfe0-71aed9a8acbe None None] For port eff181be-ae57-4e97-ba55-bdbbf58007bd, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=eff181be-ae57-4e97-ba55-bdbbf58007bd,segment=NetworkSegment(b05f5d43-d878-4233-882c-c327afc320d8),segment_id=b05f5d43-d878-4233-882c-c327afc320d8)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:44:39.391854 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d05827f7-272c-4e0f-bfe0-71aed9a8acbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:39.437603 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'name': 'router1', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:44:26Z', 'updated_at': '2021-11-21T13:44:36Z', 'revision_number': 2, 'project_id': '272d0fee05e248aba40a29566e203eaf', 'gw_port_host': None, '_interfaces': [{'id': 'eff181be-ae57-4e97-ba55-bdbbf58007bd', 'name': '', 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'mac_address': 'fa:16:3e:fc:1b:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f497c47a-25e3-40c0-839e-9b5cf222fe03', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:44:36Z', 'updated_at': '2021-11-21T13:44:39Z', 'revision_number': 4, 'project_id': '272d0fee05e248aba40a29566e203eaf', 'subnets': [{'id': 'f497c47a-25e3-40c0-839e-9b5cf222fe03', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'cc0186fa-86db-4358-82eb-ef697718e90d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:44:39.439887 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d05827f7-272c-4e0f-bfe0-71aed9a8acbe None None] Pushing event updated for resources: {'Port': ['ID=eff181be-ae57-4e97-ba55-bdbbf58007bd,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:39.467552 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d959cce8-b085-4ebc-a1a1-b8d18d565092 None None] The sync data for ids ['55a0ca88-eab8-48f4-ba27-52a84ac9983c'] in dv-cinder-768458-12-iscsi is: [{'id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'name': 'router1', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:44:26Z', 'updated_at': '2021-11-21T13:44:36Z', 'revision_number': 2, 'project_id': '272d0fee05e248aba40a29566e203eaf', 'gw_port_host': None, '_interfaces': [{'id': 'eff181be-ae57-4e97-ba55-bdbbf58007bd', 'name': '', 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'mac_address': 'fa:16:3e:fc:1b:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f497c47a-25e3-40c0-839e-9b5cf222fe03', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:44:36Z', 'updated_at': '2021-11-21T13:44:39Z', 'revision_number': 4, 'project_id': '272d0fee05e248aba40a29566e203eaf', 'subnets': [{'id': 'f497c47a-25e3-40c0-839e-9b5cf222fe03', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'cc0186fa-86db-4358-82eb-ef697718e90d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:44:39.895508 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47352) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:44:40.004137 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89a8940d-4607-40fa-8b63-a551f721252b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:44:40.011488 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-89a8940d-4607-40fa-8b63-a551f721252b admin admin] 10.222.0.11 "GET /v2.0/networks/67069811-a3d5-4953-8a57-e62d44750fe3 HTTP/1.1" status: 200 len: 842 time: 0.1089408 Nov 21 13:44:40.016033 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-1ea1c556-eabd-4000-9391-b08d3e5a07e8 admin admin] Request body: {'subnet': {'name': 'public-subnet', 'gateway_ip': '172.27.1.1', 'cidr': '172.27.1.0/24', 'enable_dhcp': False, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:44:40.043180 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ea1c556-eabd-4000-9391-b08d3e5a07e8 admin admin] Made reservation on behalf of a8cf82ee5982490d8c74cb5553b021ce for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:44:40.045515 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1ea1c556-eabd-4000-9391-b08d3e5a07e8 admin admin] Publish callbacks [] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:40.342392 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.objects.ports [None req-1ea1c556-eabd-4000-9391-b08d3e5a07e8 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=109041) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 21 13:44:40.342828 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1ea1c556-eabd-4000-9391-b08d3e5a07e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:40.400948 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ea1c556-eabd-4000-9391-b08d3e5a07e8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=95d11680-e5b5-4d2e-bab7-c3bed6fa33a8,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:40.405414 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ea1c556-eabd-4000-9391-b08d3e5a07e8 admin admin] Checking segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:44:40.405785 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ea1c556-eabd-4000-9391-b08d3e5a07e8 admin admin] Network hostable DHCP agents. Network: 67069811-a3d5-4953-8a57-e62d44750fe3, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:44:40.426347 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ea1c556-eabd-4000-9391-b08d3e5a07e8 admin admin] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:44:40.437359 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-1ea1c556-eabd-4000-9391-b08d3e5a07e8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 67069811-a3d5-4953-8a57-e62d44750fe3) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:44:40.442087 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ea1c556-eabd-4000-9391-b08d3e5a07e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:44:40.442841 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1ea1c556-eabd-4000-9391-b08d3e5a07e8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:40.446914 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-027fb2eb-d27e-44b3-aede-fc8f220e1975 None None] Network 67069811-a3d5-4953-8a57-e62d44750fe3 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:44:40.469881 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-1ea1c556-eabd-4000-9391-b08d3e5a07e8 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4533699 Nov 21 13:44:40.583411 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfbf454b-4c76-4994-98a2-caa6cdf61924 None None] Network 67069811-a3d5-4953-8a57-e62d44750fe3 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:44:42.860882 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47360) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:44:42.989672 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-c93c7210-a87a-472a-8d7d-273162e22d15 admin admin] 10.222.0.11 "GET /v2.0/routers/55a0ca88-eab8-48f4-ba27-52a84ac9983c HTTP/1.1" status: 200 len: 710 time: 0.1276383 Nov 21 13:44:43.077070 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f59c6cf7-1fdf-4cdf-9f00-22cbf7d151e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:44:43.078366 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-f59c6cf7-1fdf-4cdf-9f00-22cbf7d151e3 admin admin] 10.222.0.11 "GET /v2.0/networks/67069811-a3d5-4953-8a57-e62d44750fe3 HTTP/1.1" status: 200 len: 886 time: 0.0828481 Nov 21 13:44:43.088088 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:44:43.398711 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:43.629717 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:43.705753 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:43.808807 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Allocated IP 172.27.1.165 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/4fcfbcf1-5773-49c4-8312-a237e07966f3) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:44:43.904667 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:43.938982 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:43.982324 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:44:43.985163 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:44:43.989164 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:44:43.994416 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Pushing event updated for resources: {'Port': ['ID=4fcfbcf1-5773-49c4-8312-a237e07966f3,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:44.231180 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:44.424617 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-468252', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-473254', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-58401'] for router, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:44.427995 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-468275', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-468229', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-468234', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-473265'] for router, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:44.534496 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Router 55a0ca88-eab8-48f4-ba27-52a84ac9983c has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:44:44.727693 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:44:44.731923 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] Publish callbacks [] for router, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:44.733215 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-4089eb9b-fc7e-4d5e-8793-331ddf188b53 admin admin] 10.222.0.11 "PUT /v2.0/routers/55a0ca88-eab8-48f4-ba27-52a84ac9983c HTTP/1.1" status: 200 len: 890 time: 1.6485269 Nov 21 13:44:45.683342 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device eff181be-ae57-4e97-ba55-bdbbf58007bd up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:44:45.731884 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port eff181be-ae57-4e97-ba55-bdbbf58007bd triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:44:45.732189 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:46.421083 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Sync routers for ids ['55a0ca88-eab8-48f4-ba27-52a84ac9983c'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:44:46.431863 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Routers {'55a0ca88-eab8-48f4-ba27-52a84ac9983c'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:44:46.432515 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:44:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['55a0ca88-eab8-48f4-ba27-52a84ac9983c'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:44:46.641257 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Set router 55a0ca88-eab8-48f4-ba27-52a84ac9983c gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:44:47.100659 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'name': 'router1', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.165'}], 'enable_snat': True}, 'gw_port_id': '4fcfbcf1-5773-49c4-8312-a237e07966f3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:44:26Z', 'updated_at': '2021-11-21T13:44:44Z', 'revision_number': 4, 'project_id': '272d0fee05e248aba40a29566e203eaf', 'gw_port': {'id': '4fcfbcf1-5773-49c4-8312-a237e07966f3', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:92:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:44:43Z', 'updated_at': '2021-11-21T13:44:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'eff181be-ae57-4e97-ba55-bdbbf58007bd', 'name': '', 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'mac_address': 'fa:16:3e:fc:1b:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f497c47a-25e3-40c0-839e-9b5cf222fe03', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:44:36Z', 'updated_at': '2021-11-21T13:44:39Z', 'revision_number': 5, 'project_id': '272d0fee05e248aba40a29566e203eaf', 'subnets': [{'id': 'f497c47a-25e3-40c0-839e-9b5cf222fe03', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'cc0186fa-86db-4358-82eb-ef697718e90d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:44:47.150795 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Checking router: 55a0ca88-eab8-48f4-ba27-52a84ac9983c for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:44:47.151154 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Updating router 55a0ca88-eab8-48f4-ba27-52a84ac9983c port 4fcfbcf1-5773-49c4-8312-a237e07966f3 binding host dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:44:47.197562 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:47.256919 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47372) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:44:47.383935 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-affc213d-de7f-49b9-832a-15e86c4ead37 admin admin] 10.222.0.11 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1090813 Nov 21 13:44:47.527794 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Publish callbacks [] for port, precommit_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:47.533459 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:47.585856 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Attempting to bind port 4fcfbcf1-5773-49c4-8312-a237e07966f3 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:44:47.585856 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Attempting to bind port 4fcfbcf1-5773-49c4-8312-a237e07966f3 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:44:47.586121 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Attempting to bind port 4fcfbcf1-5773-49c4-8312-a237e07966f3 on network 67069811-a3d5-4953-8a57-e62d44750fe3 {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:44:47.591376 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afa4cea7-d811-45b5-a7f8-3c6e6071c292 None None] Pushing event updated for resources: {'Port': ['ID=4fcfbcf1-5773-49c4-8312-a237e07966f3,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:47.596381 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 44, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:44:47.596762 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Checking segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:44:47.597160 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:47.597547 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Bound using segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:44:47.598009 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Bound port: 4fcfbcf1-5773-49c4-8312-a237e07966f3, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:44:47.598857 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:47.647985 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] For port 4fcfbcf1-5773-49c4-8312-a237e07966f3, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:44:47.650929 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] For port 4fcfbcf1-5773-49c4-8312-a237e07966f3, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=4fcfbcf1-5773-49c4-8312-a237e07966f3,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:44:47.655372 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:47.713781 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Routers {'55a0ca88-eab8-48f4-ba27-52a84ac9983c'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:44:47.714467 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:44:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['55a0ca88-eab8-48f4-ba27-52a84ac9983c'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:44:47.719246 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afa4cea7-d811-45b5-a7f8-3c6e6071c292 None None] Pushing event updated for resources: {'Port': ['ID=4fcfbcf1-5773-49c4-8312-a237e07966f3,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:47.824876 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] Set router 55a0ca88-eab8-48f4-ba27-52a84ac9983c gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:44:48.041001 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'name': 'router1', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.165'}], 'enable_snat': True}, 'gw_port_id': '4fcfbcf1-5773-49c4-8312-a237e07966f3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:44:26Z', 'updated_at': '2021-11-21T13:44:44Z', 'revision_number': 4, 'project_id': '272d0fee05e248aba40a29566e203eaf', 'gw_port': {'id': '4fcfbcf1-5773-49c4-8312-a237e07966f3', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:92:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:44:43Z', 'updated_at': '2021-11-21T13:44:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'eff181be-ae57-4e97-ba55-bdbbf58007bd', 'name': '', 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'mac_address': 'fa:16:3e:fc:1b:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f497c47a-25e3-40c0-839e-9b5cf222fe03', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:44:36Z', 'updated_at': '2021-11-21T13:44:39Z', 'revision_number': 5, 'project_id': '272d0fee05e248aba40a29566e203eaf', 'subnets': [{'id': 'f497c47a-25e3-40c0-839e-9b5cf222fe03', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'cc0186fa-86db-4358-82eb-ef697718e90d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:44:48.067463 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5ef1a5a-3054-4b67-83cb-b2ecf86b704b None None] The sync data for ids ['55a0ca88-eab8-48f4-ba27-52a84ac9983c'] in dv-cinder-768458-12-iscsi is: [{'id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'name': 'router1', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.165'}], 'enable_snat': True}, 'gw_port_id': '4fcfbcf1-5773-49c4-8312-a237e07966f3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:44:26Z', 'updated_at': '2021-11-21T13:44:44Z', 'revision_number': 4, 'project_id': '272d0fee05e248aba40a29566e203eaf', 'gw_port': {'id': '4fcfbcf1-5773-49c4-8312-a237e07966f3', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f7:92:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:44:43Z', 'updated_at': '2021-11-21T13:44:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'eff181be-ae57-4e97-ba55-bdbbf58007bd', 'name': '', 'network_id': 'e11c0253-9b2e-438c-a8c8-d25bc94867d5', 'tenant_id': '272d0fee05e248aba40a29566e203eaf', 'mac_address': 'fa:16:3e:fc:1b:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55a0ca88-eab8-48f4-ba27-52a84ac9983c', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'f497c47a-25e3-40c0-839e-9b5cf222fe03', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:44:36Z', 'updated_at': '2021-11-21T13:44:39Z', 'revision_number': 5, 'project_id': '272d0fee05e248aba40a29566e203eaf', 'subnets': [{'id': 'f497c47a-25e3-40c0-839e-9b5cf222fe03', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'cc0186fa-86db-4358-82eb-ef697718e90d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:44:49.724468 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 4fcfbcf1-5773-49c4-8312-a237e07966f3 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:44:49.787554 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 4fcfbcf1-5773-49c4-8312-a237e07966f3 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:44:49.789485 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:49.869435 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:49.890110 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port 4fcfbcf1-5773-49c4-8312-a237e07966f3, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=4fcfbcf1-5773-49c4-8312-a237e07966f3,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:44:49.894613 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:49.949354 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=4fcfbcf1-5773-49c4-8312-a237e07966f3,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:44:51.703988 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 4fcfbcf1-5773-49c4-8312-a237e07966f3 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:44:51.766678 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 4fcfbcf1-5773-49c4-8312-a237e07966f3 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:44:51.767531 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:44:56.626215 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 5 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:45:00.127415 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-cb87b625-fee4-4a73-bc2c-cab0d8c59329 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:45:02.525475 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-f16386db-a81b-4e71-b415-bc1a4c52da00 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:45:03.816685 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:45:05.005891 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:45:05.816996 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:45:30.131673 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-cdf21bae-c82d-4a02-b42a-8b7386028420 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:45:32.523191 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-f45e2e96-ac4a-40ed-9328-bb399b80461c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:45:33.626583 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 5 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:45:33.810861 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:45:34.997552 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:45:35.816308 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:00.134881 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-b709114e-7c64-4aa9-b6b0-78b3143a5b93 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:02.524605 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-7bddd6e4-1ce4-45ec-8e87-f946d86df554 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:03.807679 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:05.000491 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:05.810055 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:07.761925 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47858) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:46:07.822829 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.pecan_wsgi.hooks.translation [None req-03a7eed0-fa0f-485c-bf97-fdc2f1cb40ed admin admin] GET failed (client error): The resource could not be found. Nov 21 13:46:07.824118 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-03a7eed0-fa0f-485c-bf97-fdc2f1cb40ed admin admin] 10.222.0.11 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0612268 Nov 21 13:46:07.987171 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33cea91b-4d81-4762-9cea-3a949b6da447 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:07.988596 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-33cea91b-4d81-4762-9cea-3a949b6da447 admin admin] 10.222.0.11 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1598809 Nov 21 13:46:10.253872 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47868) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:46:10.343299 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-def56d17-822c-4f0e-b720-d03ee4dd0f72 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:10.344618 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-def56d17-822c-4f0e-b720-d03ee4dd0f72 admin admin] 10.222.0.11 "GET /v2.0/subnets/f497c47a-25e3-40c0-839e-9b5cf222fe03 HTTP/1.1" status: 200 len: 849 time: 0.0897825 Nov 21 13:46:10.354357 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:46:10.436622 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Publish callbacks [] for subnet, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:10.574623 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8731000553036'] for subnet, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:10.606512 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:10.607107 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:10.624894 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] 10.222.0.11 "PUT /v2.0/subnets/f497c47a-25e3-40c0-839e-9b5cf222fe03 HTTP/1.1" status: 200 len: 868 time: 0.2575388 Nov 21 13:46:10.625166 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12e10e14-90d0-47d8-9c87-333f2b88d09a None None] Network e11c0253-9b2e-438c-a8c8-d25bc94867d5 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:46:10.626592 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 5 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:46:10.635198 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Pushing event updated for resources: {'Subnet': ['ID=f497c47a-25e3-40c0-839e-9b5cf222fe03,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:46:10.643016 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:46:10.643386 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:46:10.643738 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:46:10.644107 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:46:10.644448 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:46:10.644802 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:46:10.645143 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:46:10.645479 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:46:10.645814 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:46:10.646146 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:46:10.646483 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:46:10.646810 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1676108a-508c-46ff-8d62-71904d3cec8c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:46:10.961138 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-8c501b6e-5668-4315-b8a3-25556dcb7270 None None] Provisioning complete for port 631357b8-a8c7-4caa-abba-3372e2bf82cb triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:46:10.961507 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8c501b6e-5668-4315-b8a3-25556dcb7270 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:11.047712 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-8c501b6e-5668-4315-b8a3-25556dcb7270 None None] Provisioning complete for port eff181be-ae57-4e97-ba55-bdbbf58007bd triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:46:11.048032 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8c501b6e-5668-4315-b8a3-25556dcb7270 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:12.892807 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47876) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:46:13.089788 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82050fe3-32d1-47fe-bd7a-28da4ff1f137 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:13.090148 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82050fe3-32d1-47fe-bd7a-28da4ff1f137 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:13.091676 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-82050fe3-32d1-47fe-bd7a-28da4ff1f137 admin admin] 10.222.0.11 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1979091 Nov 21 13:46:15.391750 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47884) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:46:15.520779 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8340c929-2039-4cc6-9fff-b1a27ee922c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:15.521250 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8340c929-2039-4cc6-9fff-b1a27ee922c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:15.522756 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-8340c929-2039-4cc6-9fff-b1a27ee922c4 admin admin] 10.222.0.11 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1300259 Nov 21 13:46:17.785998 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47892) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:46:17.911909 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6504a9be-c06d-460c-8100-5e3de0162245 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:17.914143 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-6504a9be-c06d-460c-8100-5e3de0162245 admin admin] 10.222.0.11 "GET /v2.0/networks/67069811-a3d5-4953-8a57-e62d44750fe3 HTTP/1.1" status: 200 len: 886 time: 0.1269970 Nov 21 13:46:20.187756 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 47900) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:46:20.366388 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dde35a34-51c3-4ec0-b1e6-0af6f0093f99 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:20.367741 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-dde35a34-51c3-4ec0-b1e6-0af6f0093f99 admin admin] 10.222.0.11 "GET /v2.0/networks/e11c0253-9b2e-438c-a8c8-d25bc94867d5 HTTP/1.1" status: 200 len: 869 time: 0.1790175 Nov 21 13:46:22.621996 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 47910) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:46:22.746699 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23848bee-e484-4c0c-9d4e-4ad6d6a94ce4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:22.747195 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23848bee-e484-4c0c-9d4e-4ad6d6a94ce4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:22.748729 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-23848bee-e484-4c0c-9d4e-4ad6d6a94ce4 admin admin] 10.222.0.11 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1257727 Nov 21 13:46:25.015986 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 47918) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:46:25.105043 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d85214e3-5b22-46ba-9b02-59c5f1df03c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:25.105487 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d85214e3-5b22-46ba-9b02-59c5f1df03c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:25.106951 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-d85214e3-5b22-46ba-9b02-59c5f1df03c4 admin admin] 10.222.0.11 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0900288 Nov 21 13:46:27.349213 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 47926) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:46:27.436259 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3838d1b1-f95a-4f1f-a695-9d44dae8a7e6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:27.437555 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-3838d1b1-f95a-4f1f-a695-9d44dae8a7e6 admin admin] 10.222.0.11 "GET /v2.0/subnets/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8 HTTP/1.1" status: 200 len: 816 time: 0.0874076 Nov 21 13:46:29.715987 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47934) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:46:29.807708 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89c74968-b537-4f09-bc46-6d37572fa726 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:29.809051 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-89c74968-b537-4f09-bc46-6d37572fa726 admin admin] 10.222.0.11 "GET /v2.0/subnets/f497c47a-25e3-40c0-839e-9b5cf222fe03 HTTP/1.1" status: 200 len: 868 time: 0.0921357 Nov 21 13:46:30.138187 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-36b0dfa8-5286-4c61-9758-833ce820facb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:32.527686 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-18c85de3-31bb-4ef4-a2bf-cbb80f9454ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:33.810377 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:35.004302 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:35.811526 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:47.625712 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 5 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:46:53.876429 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47988) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:46:53.924183 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [None req-d22704f2-1ef1-4cc7-bfc9-09bdcacf2e3b admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109041) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 13:46:53.925137 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-d22704f2-1ef1-4cc7-bfc9-09bdcacf2e3b admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0476832 Nov 21 13:46:56.270570 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 47996) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:46:56.330205 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.pecan_wsgi.hooks.translation [None req-1af16ea2-273a-476f-8c75-36097d9c298f admin admin] GET failed (client error): The resource could not be found. Nov 21 13:46:56.331445 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-1af16ea2-273a-476f-8c75-36097d9c298f admin admin] 10.222.0.11 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0599504 Nov 21 13:46:56.411887 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e87ecbd6-00ce-43d7-85b7-120c23eeff1c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:56.413311 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-e87ecbd6-00ce-43d7-85b7-120c23eeff1c admin admin] 10.222.0.11 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.0768411 Nov 21 13:46:58.693227 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48004) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:46:58.738838 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-9131269d-f247-4ba1-85eb-7f75b8490719 admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'shared', 'shared': True}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:46:58.759745 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9131269d-f247-4ba1-85eb-7f75b8490719 admin admin] Made reservation on behalf of a8cf82ee5982490d8c74cb5553b021ce for: {'network': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:46:58.762000 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9131269d-f247-4ba1-85eb-7f75b8490719 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:58.788657 dv-cinder-768458-12-iscsi neutron-server[109041]: WARNING neutron.services.revisions.revision_plugin [None req-9131269d-f247-4ba1-85eb-7f75b8490719 admin admin] Could not find related network for resource to bump revision. Nov 21 13:46:58.805585 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9131269d-f247-4ba1-85eb-7f75b8490719 admin admin] vlan segment allocate from pool success with {'vlan_id': 505, 'physical_network': 'physnet1'} {{(pid=109041) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:46:58.815214 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9131269d-f247-4ba1-85eb-7f75b8490719 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:58.815555 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.segments_db [None req-9131269d-f247-4ba1-85eb-7f75b8490719 admin admin] Added segment 85a68096-6a25-4344-bcb7-1bb29b188cdf of type vlan for network c04e4031-26f3-476a-92dc-8476ff89cbca Nov 21 13:46:58.863576 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9131269d-f247-4ba1-85eb-7f75b8490719 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:58.888591 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9131269d-f247-4ba1-85eb-7f75b8490719 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:58.889444 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9131269d-f247-4ba1-85eb-7f75b8490719 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:46:58.890035 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9131269d-f247-4ba1-85eb-7f75b8490719 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:46:58.938132 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-9131269d-f247-4ba1-85eb-7f75b8490719 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2438576 Nov 21 13:46:58.949947 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9131269d-f247-4ba1-85eb-7f75b8490719 admin admin] Pushing event updated for resources: {'Network': ['ID=c04e4031-26f3-476a-92dc-8476ff89cbca,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:46:58.960991 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network c04e4031-26f3-476a-92dc-8476ff89cbca details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:47:00.139615 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-3f832c7e-dc70-4d5b-b29b-66f1aa476e73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:01.224234 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 48012) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:47:01.287993 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.pecan_wsgi.hooks.translation [None req-3cdcde47-7141-4c03-b4d8-2de1a5b8fa0c admin admin] GET failed (client error): The resource could not be found. Nov 21 13:47:01.289809 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-3cdcde47-7141-4c03-b4d8-2de1a5b8fa0c admin admin] 10.222.0.11 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0646150 Nov 21 13:47:01.390611 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-780ff34e-f55f-4dfe-99dc-31e443c8a7e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:47:01.392057 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-780ff34e-f55f-4dfe-99dc-31e443c8a7e8 admin admin] 10.222.0.11 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0977075 Nov 21 13:47:01.401967 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'name': 'shared-subnet', 'ip_version': 4, 'network_id': 'c04e4031-26f3-476a-92dc-8476ff89cbca', 'description': 'shared-subnet'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:47:01.422227 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Made reservation on behalf of a8cf82ee5982490d8c74cb5553b021ce for: {'subnet': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:47:01.424651 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Publish callbacks [] for subnet, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:01.583047 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for subnet, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:01.637044 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bfdeefb6-0e0c-4625-b35a-cfbc80386912,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:47:01.646885 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:01.647257 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:01.647605 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:01.648489 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:01.648824 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:01.649174 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:01.649510 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:01.649854 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:01.650186 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:01.650510 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:01.650831 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:01.651154 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:01.654027 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Checking segment: {'id': '85a68096-6a25-4344-bcb7-1bb29b188cdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': 'c04e4031-26f3-476a-92dc-8476ff89cbca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109040) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:47:01.654377 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Network hostable DHCP agents. Network: c04e4031-26f3-476a-92dc-8476ff89cbca, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109040) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:47:01.670561 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Network c04e4031-26f3-476a-92dc-8476ff89cbca is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109040) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:47:01.680006 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, c04e4031-26f3-476a-92dc-8476ff89cbca) {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:47:01.683897 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:47:01.684491 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:01.690413 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3da764cd-30b9-43c6-b60c-626a07f4e226 None None] Network c04e4031-26f3-476a-92dc-8476ff89cbca requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:47:01.699774 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-e63191f9-eb3a-433b-96e4-393679a99b24 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3011329 Nov 21 13:47:01.845101 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6b3ed262-49ce-5e18-b10a-0ddd25bea067-c04e4031-26f3-476a-92dc-8476ff89cbca', 'network_id': 'c04e4031-26f3-476a-92dc-8476ff89cbca', 'tenant_id': 'a8cf82ee5982490d8c74cb5553b021ce', 'fixed_ips': [{'subnet_id': 'bfdeefb6-0e0c-4625-b35a-cfbc80386912'}]}} from dv-cinder-768458-12-iscsi. {{(pid=109042) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 21 13:47:01.846006 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:01.986484 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.db_base_plugin_common [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Allocated IP 192.168.233.2 (c04e4031-26f3-476a-92dc-8476ff89cbca/bfdeefb6-0e0c-4625-b35a-cfbc80386912/97d9d72a-9a40-421f-ad2c-5946a7195799) {{(pid=109042) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:47:02.222023 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Publish callbacks [] for port, precommit_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:02.228301 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:02.275370 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Network c04e4031-26f3-476a-92dc-8476ff89cbca is already hosted by enough agents. {{(pid=109042) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:47:02.279330 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.base_scheduler [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Resources bound (agent type, host, resource id): {{(pid=109042) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:47:02.281244 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Pushing event updated for resources: {'Port': ['ID=97d9d72a-9a40-421f-ad2c-5946a7195799,revision_number=1']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:47:02.284735 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Received port after_create {{(pid=109042) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:47:02.292419 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:02.292797 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:02.293137 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:02.293473 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:02.293809 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:02.294236 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:02.294578 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:02.294903 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:02.295233 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:02.295558 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:02.295903 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:02.296225 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:47:02.350237 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Attempting to bind port 97d9d72a-9a40-421f-ad2c-5946a7195799 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:47:02.350711 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Attempting to bind port 97d9d72a-9a40-421f-ad2c-5946a7195799 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '85a68096-6a25-4344-bcb7-1bb29b188cdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': 'c04e4031-26f3-476a-92dc-8476ff89cbca'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:47:02.351710 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Attempting to bind port 97d9d72a-9a40-421f-ad2c-5946a7195799 on network c04e4031-26f3-476a-92dc-8476ff89cbca {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:47:02.356753 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 46, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:47:02.357131 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Checking segment: {'id': '85a68096-6a25-4344-bcb7-1bb29b188cdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': 'c04e4031-26f3-476a-92dc-8476ff89cbca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:47:02.357529 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:02.357949 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Bound using segment: {'id': '85a68096-6a25-4344-bcb7-1bb29b188cdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': 'c04e4031-26f3-476a-92dc-8476ff89cbca'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:47:02.358414 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Bound port: 97d9d72a-9a40-421f-ad2c-5946a7195799, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '85a68096-6a25-4344-bcb7-1bb29b188cdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': 'c04e4031-26f3-476a-92dc-8476ff89cbca'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:47:02.358811 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:02.420242 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] For port 97d9d72a-9a40-421f-ad2c-5946a7195799, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:47:02.423276 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] For port 97d9d72a-9a40-421f-ad2c-5946a7195799, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=97d9d72a-9a40-421f-ad2c-5946a7195799,segment=NetworkSegment(85a68096-6a25-4344-bcb7-1bb29b188cdf),segment_id=85a68096-6a25-4344-bcb7-1bb29b188cdf)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:47:02.427900 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:02.483270 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15bac303-7f6f-45fc-8b1f-ffaafb434e9c None None] Pushing event updated for resources: {'Port': ['ID=97d9d72a-9a40-421f-ad2c-5946a7195799,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:47:02.532820 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4d5d7f86-963a-40a5-ac8d-66ca02d41fc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:03.283284 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb73ea1a-58c7-40a4-b6b3-bfb63ae5492c None None] Network c04e4031-26f3-476a-92dc-8476ff89cbca requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:47:03.346872 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-448c8dc2-07be-47d5-bf42-b76399e949c7 None None] Provisioning complete for port 97d9d72a-9a40-421f-ad2c-5946a7195799 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:47:03.347232 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-448c8dc2-07be-47d5-bf42-b76399e949c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:03.493468 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-448c8dc2-07be-47d5-bf42-b76399e949c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:03.531264 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-448c8dc2-07be-47d5-bf42-b76399e949c7 None None] For port 97d9d72a-9a40-421f-ad2c-5946a7195799, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=97d9d72a-9a40-421f-ad2c-5946a7195799,segment=NetworkSegment(85a68096-6a25-4344-bcb7-1bb29b188cdf),segment_id=85a68096-6a25-4344-bcb7-1bb29b188cdf)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:47:03.538524 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-448c8dc2-07be-47d5-bf42-b76399e949c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:03.607313 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-448c8dc2-07be-47d5-bf42-b76399e949c7 None None] Pushing event updated for resources: {'Port': ['ID=97d9d72a-9a40-421f-ad2c-5946a7195799,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:47:03.763725 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 97d9d72a-9a40-421f-ad2c-5946a7195799 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:47:03.791418 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-37b2c237-6cdf-4648-8a76-ae56fce9f3fb None None] Provisioning complete for port 97d9d72a-9a40-421f-ad2c-5946a7195799 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:47:03.791717 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-37b2c237-6cdf-4648-8a76-ae56fce9f3fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:03.859958 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:03.869892 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 97d9d72a-9a40-421f-ad2c-5946a7195799 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:47:03.870254 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:05.007501 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:05.813734 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:24.623185 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 5 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:47:30.140928 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-cf72d2c8-d22e-4d20-b3f9-6b3de3d435d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:32.535771 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-23a382a8-4777-4fb8-8945-8f13c935b216 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:33.817641 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:35.008981 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:47:35.815597 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:00.142587 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-43969c83-9cae-4f56-9566-71782bd90faa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:01.622001 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 5 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:48:02.538495 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-b59b04bf-2ace-423e-bf7c-ae57b3d3f5fd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:03.820788 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:05.011887 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:05.818487 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:18.638815 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 48058) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:48:18.644600 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [None req-42ef1810-9404-4ea2-91a2-4b4287aae785 tempest-verify_tempest_config-1361804759 tempest-verify_tempest_config-1361804759-project] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109040) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 13:48:18.645603 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-42ef1810-9404-4ea2-91a2-4b4287aae785 tempest-verify_tempest_config-1361804759 tempest-verify_tempest_config-1361804759-project] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0058308 Nov 21 13:48:18.933780 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48076) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:48:19.033791 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:19.104936 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:19.108585 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:19.155493 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=2974c19f49644ea9a18ba7d89f32b5cb&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2206728 Nov 21 13:48:19.156328 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=417bed12-c431-42f5-ad62-44f29914921e,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:48:19.158108 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48082) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:48:19.173693 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:48:19.174049 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:48:19.174397 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:48:19.174754 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:48:19.175091 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:48:19.175422 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:48:19.175774 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:48:19.176141 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:48:19.176471 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:48:19.176823 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:48:19.177147 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:48:19.177467 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3aeb24f5-c634-441d-9654-a4ef0b152652 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:48:19.221353 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d6d94cee-bd81-4fe2-89bf-822f94bf2bce admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:19.241120 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d6d94cee-bd81-4fe2-89bf-822f94bf2bce admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:19.330252 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d6d94cee-bd81-4fe2-89bf-822f94bf2bce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:19.332851 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d6d94cee-bd81-4fe2-89bf-822f94bf2bce admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:19.336888 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-d6d94cee-bd81-4fe2-89bf-822f94bf2bce admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/417bed12-c431-42f5-ad62-44f29914921e HTTP/1.1" status: 204 len: 168 time: 0.1755342 Nov 21 13:48:19.342334 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6d94cee-bd81-4fe2-89bf-822f94bf2bce admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=417bed12-c431-42f5-ad62-44f29914921e,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:48:30.144366 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d05b1bc5-b942-42c9-9c0c-2258250255f6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:32.539465 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-3d330f45-b180-4564-a948-30d17addded3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:33.822137 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:35.014701 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:35.820165 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:48:38.620294 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 5 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:49:00.146370 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-1ae758ef-6c34-41f5-8c10-d5f049d7907e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:49:02.539150 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-305119df-b5ab-4e76-b6bc-6855f356b3b8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:49:03.824677 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:49:05.018649 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:49:05.826944 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:49:15.617981 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 5 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:49:30.147819 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8afccfb7-0771-48a4-aec6-abd5fa8251fd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:49:32.540311 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ad67f65a-0d94-43da-992b-82e7dafc4998 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:49:33.827860 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:49:35.021556 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:49:35.818818 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:49:52.367435 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-473098'] for agent, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:49:52.616975 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:50:00.148916 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-93c31477-41b6-42a3-bdda-56448756d3a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:50:02.540867 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0ed42885-f681-4ad6-9118-033a7317671d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:50:03.832155 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:50:05.024616 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:50:05.820309 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:50:06.864169 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48154) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:50:06.965917 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-6c540ba8-4f06-4efb-814c-c98876fcd9da admin admin] 10.222.0.11 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4559 time: 0.1006558 Nov 21 13:50:09.214724 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48164) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:50:09.268447 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-0b5614fb-59e1-41e2-8ae3-e5e5751d2a29 admin admin] 10.222.0.11 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4559 time: 0.0525975 Nov 21 13:50:22.337301 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:50:29.616346 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:50:30.150278 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6c80d7e5-9c25-4c44-8037-0c217a175d13 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:50:32.541718 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c156cee2-13ef-47cb-b72c-37a27f0ce6a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:50:33.835087 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:50:35.027169 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:50:35.821677 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:50:52.352529 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:00.153126 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-16e30394-cb11-41a7-854e-543ac2f4579f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:02.544584 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-7f354b08-a1b5-41f9-bb89-8bf02de2c88f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:03.844804 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:05.035237 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:05.823305 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:06.616411 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:51:22.351824 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:30.155920 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-81c7e8f5-b7b9-4196-9f6d-65a02132306c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:32.546980 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d6524968-c641-458a-93c2-fa702077d5dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:33.847197 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:35.042878 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:35.830905 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:37.370597 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 48278) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:37.604668 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-2083364250-network', 'tenant_id': '389c281a19bb49e583633f57108f7f69'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:37.634032 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Made reservation on behalf of 389c281a19bb49e583633f57108f7f69 for: {'network': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:51:37.636868 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:37.646519 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:37.724693 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:37.729099 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:37.760039 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a98a60b-a06a-4423-8012-d18fff285196,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:37.769011 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] vlan segment allocate from pool success with {'vlan_id': 507, 'physical_network': 'physnet1'} {{(pid=109040) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:51:37.774485 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:37.775060 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:37.775403 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:37.776038 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:37.776450 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:37.777052 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:37.777478 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:37.777914 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:37.778228 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:37.778665 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:37.778996 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:37.779329 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Tracked resource versions report: Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: pushed versions: Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: { 'AddressGroup': {'1.2'}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'ConntrackHelper': {'1.0'}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Log': {'1.0'}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Network': {'1.1'}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Port': {'1.7'}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'PortForwarding': {'1.2'}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'QosPolicy': {'1.10'}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'SecurityGroup': {'1.5'}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'SecurityGroupRule': {'1.2'}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'SubPort': {'1.0'}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Subnet': {'1.1'}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Trunk': {'1.1'}} Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: consumer versions: Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: { DHCP agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: HyperV agent@hv-cinder-76845: {}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: L3 agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: Metadata agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: Metering agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: Open vSwitch agent@dv-cinder-768458-12-iscsi: { 'AddressGroup': '1.2', Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'ConntrackHelper': '1.0', Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Log': '1.0', Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Network': '1.1', Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Port': '1.7', Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'PortForwarding': '1.2', Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'QosPolicy': '1.10', Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'SecurityGroup': '1.5', Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'SecurityGroupRule': '1.2', Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'SubPort': '1.0', Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Subnet': '1.1', Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: 'Trunk': '1.1'}} Nov 21 13:51:37.780704 dv-cinder-768458-12-iscsi neutron-server[109040]: {{(pid=109040) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 21 13:51:37.789417 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:37.789748 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.segments_db [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Added segment 8f3a2505-9e61-424e-8456-2758b99b070c of type vlan for network ea19090b-8034-4904-8b6c-1752befe0b5a Nov 21 13:51:37.834649 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:37.860294 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:37.869212 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:37.870072 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:37.891217 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.5195227 Nov 21 13:51:37.891790 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48314) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:37.903006 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Request body: {'subnet': {'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-2083364250-subnet', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:37.938313 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Made reservation on behalf of 389c281a19bb49e583633f57108f7f69 for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:51:37.942786 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Publish callbacks [] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:37.943197 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b1cc2bc-a42a-4eb6-ba69-77804d4ad3c2 admin admin] Pushing event updated for resources: {'Network': ['ID=ea19090b-8034-4904-8b6c-1752befe0b5a,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:37.954067 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network ea19090b-8034-4904-8b6c-1752befe0b5a details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:51:38.117348 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.168917 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:38.181602 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:38.182076 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:38.182411 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:38.182772 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:38.183097 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:38.183421 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:38.183741 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:38.184142 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:38.184467 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:38.184735 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:38.185128 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:38.185370 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Tracked resource versions report: Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: pushed versions: Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: { 'AddressGroup': {'1.2'}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'ConntrackHelper': {'1.0'}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Log': {'1.0'}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Network': {'1.1'}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Port': {'1.7'}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'PortForwarding': {'1.2'}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'QosPolicy': {'1.10'}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'SecurityGroup': {'1.5'}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'SecurityGroupRule': {'1.2'}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'SubPort': {'1.0'}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Subnet': {'1.1'}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Trunk': {'1.1'}} Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: consumer versions: Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: { DHCP agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: HyperV agent@hv-cinder-76845: {}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: L3 agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: Metadata agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: Metering agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: Open vSwitch agent@dv-cinder-768458-12-iscsi: { 'AddressGroup': '1.2', Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'ConntrackHelper': '1.0', Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Log': '1.0', Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Network': '1.1', Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Port': '1.7', Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'PortForwarding': '1.2', Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'QosPolicy': '1.10', Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'SecurityGroup': '1.5', Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'SecurityGroupRule': '1.2', Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'SubPort': '1.0', Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Subnet': '1.1', Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: 'Trunk': '1.1'}} Nov 21 13:51:38.186417 dv-cinder-768458-12-iscsi neutron-server[109041]: {{(pid=109041) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 21 13:51:38.218607 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Checking segment: {'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:51:38.218964 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Network hostable DHCP agents. Network: ea19090b-8034-4904-8b6c-1752befe0b5a, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:51:38.238226 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Network ea19090b-8034-4904-8b6c-1752befe0b5a is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:51:38.248505 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, ea19090b-8034-4904-8b6c-1752befe0b5a) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:38.253224 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:38.253884 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.259037 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3c31445-8191-4dc6-9372-a0818bea5af0 None None] Network ea19090b-8034-4904-8b6c-1752befe0b5a requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:51:38.289927 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-331bfce4-7a1a-4b6e-9967-f05cfce45cc6 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3946431 Nov 21 13:51:38.290914 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 48334) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:38.296628 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:38.297483 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48336) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:38.324839 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-408660', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-58304'] for router, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.327244 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-473172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-468334', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1610115', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-58419'] for router, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.386702 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.444783 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6b3ed262-49ce-5e18-b10a-0ddd25bea067-ea19090b-8034-4904-8b6c-1752befe0b5a', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0'}]}} from dv-cinder-768458-12-iscsi. {{(pid=109042) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 21 13:51:38.445909 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.521267 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-2113246939-network', 'tenant_id': '9580a66e32944e649fafe038a1d4cc4a'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:38.643213 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.720495 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.db_base_plugin_common [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Allocated IP 172.20.0.2 (ea19090b-8034-4904-8b6c-1752befe0b5a/8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0/6ba2a400-da82-40d5-8543-00a95b3ae29e) {{(pid=109042) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:51:38.727178 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Made reservation on behalf of 9580a66e32944e649fafe038a1d4cc4a for: {'network': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:51:38.732849 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.746118 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.842312 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.848689 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.903020 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] vlan segment allocate from pool success with {'vlan_id': 549, 'physical_network': 'physnet1'} {{(pid=109041) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:51:38.912038 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Publish callbacks [] for port, precommit_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.917681 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5367324-7c98-4213-b67a-a2a436c640c1,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:38.920308 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.939756 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.940314 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.segments_db [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Added segment af3504fe-7a5c-4c47-a5ed-ae3a2be59084 of type vlan for network 329f6f8a-93b1-430a-8c57-dacb018278ff Nov 21 13:51:38.944425 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Network ea19090b-8034-4904-8b6c-1752befe0b5a is already hosted by enough agents. {{(pid=109042) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:51:38.946200 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.base_scheduler [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Resources bound (agent type, host, resource id): {{(pid=109042) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:38.949121 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Received port after_create {{(pid=109042) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:51:38.983846 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:38.991879 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.019449 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.023058 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48370) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:39.037974 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Attempting to bind port 6ba2a400-da82-40d5-8543-00a95b3ae29e on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:51:39.040226 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Attempting to bind port 6ba2a400-da82-40d5-8543-00a95b3ae29e by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:51:39.040984 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Attempting to bind port 6ba2a400-da82-40d5-8543-00a95b3ae29e on network ea19090b-8034-4904-8b6c-1752befe0b5a {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:51:39.052715 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 51, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:51:39.053432 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.053824 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Checking segment: {'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:51:39.054470 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:39.054984 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.055116 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.055743 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Bound using segment: {'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:51:39.057031 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Bound port: 6ba2a400-da82-40d5-8543-00a95b3ae29e, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:51:39.058017 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.114782 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Pushing event updated for resources: {'Port': ['ID=6ba2a400-da82-40d5-8543-00a95b3ae29e,revision_number=1']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:39.123731 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:39.124536 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:39.125093 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:39.125628 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:39.126157 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:39.126700 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:39.127251 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:39.127826 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:39.128637 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:39.129191 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:39.130293 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:39.130838 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Tracked resource versions report: Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: pushed versions: Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: { 'AddressGroup': {'1.2'}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'ConntrackHelper': {'1.0'}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Log': {'1.0'}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Network': {'1.1'}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Port': {'1.7'}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'PortForwarding': {'1.2'}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'QosPolicy': {'1.10'}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'SecurityGroup': {'1.5'}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'SecurityGroupRule': {'1.2'}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'SubPort': {'1.0'}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Subnet': {'1.1'}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Trunk': {'1.1'}} Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: consumer versions: Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: { DHCP agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: HyperV agent@hv-cinder-76845: {}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: L3 agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: Metadata agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: Metering agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: Open vSwitch agent@dv-cinder-768458-12-iscsi: { 'AddressGroup': '1.2', Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'ConntrackHelper': '1.0', Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Log': '1.0', Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Network': '1.1', Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Port': '1.7', Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'PortForwarding': '1.2', Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'QosPolicy': '1.10', Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'SecurityGroup': '1.5', Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'SecurityGroupRule': '1.2', Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'SubPort': '1.0', Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Subnet': '1.1', Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: 'Trunk': '1.1'}} Nov 21 13:51:39.132187 dv-cinder-768458-12-iscsi neutron-server[109042]: {{(pid=109042) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 21 13:51:39.152792 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.8527477 Nov 21 13:51:39.153361 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48378) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:39.155566 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-987ae1e0-dd84-4e39-9c91-a5bee8a4177e admin admin] Pushing event updated for resources: {'Network': ['ID=329f6f8a-93b1-430a-8c57-dacb018278ff,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:39.160584 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-dc18daec-9d2a-4752-869a-6c8c40f82b3a admin admin] Request body: {'subnet': {'network_id': '329f6f8a-93b1-430a-8c57-dacb018278ff', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-2113246939-subnet', 'tenant_id': '9580a66e32944e649fafe038a1d4cc4a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:39.171339 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 329f6f8a-93b1-430a-8c57-dacb018278ff details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:51:39.186203 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc18daec-9d2a-4752-869a-6c8c40f82b3a admin admin] Made reservation on behalf of 9580a66e32944e649fafe038a1d4cc4a for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:51:39.190709 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-dc18daec-9d2a-4752-869a-6c8c40f82b3a admin admin] Publish callbacks [] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.195555 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] For port 6ba2a400-da82-40d5-8543-00a95b3ae29e, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:51:39.237544 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48380) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:39.249074 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] For port 6ba2a400-da82-40d5-8543-00a95b3ae29e, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=6ba2a400-da82-40d5-8543-00a95b3ae29e,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:51:39.264413 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.267931 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48384) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:39.305839 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Allocated IP 172.27.1.36 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/4b6ebcd5-75f1-45dd-b6a3-3a4972744dca) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:51:39.377865 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b8b4794-155c-4669-aae5-730d4f70c6f0 None None] Pushing event updated for resources: {'Port': ['ID=6ba2a400-da82-40d5-8543-00a95b3ae29e,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:39.467413 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-dc18daec-9d2a-4752-869a-6c8c40f82b3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.472758 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.538851 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc18daec-9d2a-4752-869a-6c8c40f82b3a admin admin] Pushing event updated for resources: {'Subnet': ['ID=b2250609-3053-4cfc-afb4-7edd4f2f599d,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:39.549908 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc18daec-9d2a-4752-869a-6c8c40f82b3a admin admin] Checking segment: {'id': 'af3504fe-7a5c-4c47-a5ed-ae3a2be59084', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 549, 'network_id': '329f6f8a-93b1-430a-8c57-dacb018278ff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:51:39.549908 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc18daec-9d2a-4752-869a-6c8c40f82b3a admin admin] Network hostable DHCP agents. Network: 329f6f8a-93b1-430a-8c57-dacb018278ff, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:51:39.556034 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.582263 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1614135741-network', 'tenant_id': 'c54a1970861a4e2eb50657ea8e7e5a0f'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:39.638033 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-367439327-network', 'tenant_id': 'c90104f2696540809e93549d7ed3695f'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:39.649418 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc18daec-9d2a-4752-869a-6c8c40f82b3a admin admin] Network 329f6f8a-93b1-430a-8c57-dacb018278ff is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:51:39.678806 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Pushing event updated for resources: {'Port': ['ID=4b6ebcd5-75f1-45dd-b6a3-3a4972744dca,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:39.697248 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Made reservation on behalf of c54a1970861a4e2eb50657ea8e7e5a0f for: {'network': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:51:39.697248 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.704568 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-network', 'tenant_id': '3d25ecbdc2ba435488271022d897a406'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:39.716663 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-dc18daec-9d2a-4752-869a-6c8c40f82b3a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 329f6f8a-93b1-430a-8c57-dacb018278ff) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:39.719340 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc18daec-9d2a-4752-869a-6c8c40f82b3a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:39.721624 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-dc18daec-9d2a-4752-869a-6c8c40f82b3a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.733972 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Made reservation on behalf of c90104f2696540809e93549d7ed3695f for: {'network': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:51:39.737213 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.738021 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ec376dd-3076-47c7-92cd-f17d689e2961 None None] Network 329f6f8a-93b1-430a-8c57-dacb018278ff requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:51:39.750753 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:51:39.756190 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.757036 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:39.760973 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:51:39.762051 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.781910 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-dc18daec-9d2a-4752-869a-6c8c40f82b3a admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.6270976 Nov 21 13:51:39.830642 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Made reservation on behalf of 3d25ecbdc2ba435488271022d897a406 for: {'network': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:51:39.833834 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.867144 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:39.903693 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2216df0f-14cf-4c3c-9262-4e09858ea36a None None] Network 329f6f8a-93b1-430a-8c57-dacb018278ff requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:51:39.981669 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.000461 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.005508 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.029693 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.064470 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] vlan segment allocate from pool success with {'vlan_id': 527, 'physical_network': 'physnet1'} {{(pid=109041) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:51:40.083515 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] vlan segment allocate from pool success with {'vlan_id': 521, 'physical_network': 'physnet1'} {{(pid=109041) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:51:40.111355 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 6ba2a400-da82-40d5-8543-00a95b3ae29e up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:51:40.117170 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.118312 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b710ded8-f848-4dbe-a8f0-f3e09e6065b0,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:40.132047 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.132581 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.segments_db [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Added segment dff676ee-13c7-426c-b4e3-70ecdefc73be of type vlan for network 33b4c37c-dd9e-42d3-8c27-369177f4f9a2 Nov 21 13:51:40.134685 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.148944 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] vlan segment allocate from pool success with {'vlan_id': 524, 'physical_network': 'physnet1'} {{(pid=109041) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:51:40.159635 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.160021 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.segments_db [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Added segment 1366d621-cbe7-4737-8733-1d29712acbd0 of type vlan for network 24c864ef-5c5a-4df8-8968-78a7fe30b188 Nov 21 13:51:40.204872 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.211231 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.211570 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.segments_db [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Added segment 87188554-865b-4f60-ac47-7f9dc768573f of type vlan for network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a Nov 21 13:51:40.293881 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 6ba2a400-da82-40d5-8543-00a95b3ae29e triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:40.294253 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.374892 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.384101 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.393676 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a8d8f563-6329-49d2-be60-2c66fef726e1,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:40.415237 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.416188 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:40.416777 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.433138 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.474767 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.540932 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.db.resource_extend [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 21 13:51:40.567462 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Pushing event updated for resources: {'Network': ['ID=24c864ef-5c5a-4df8-8968-78a7fe30b188,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:40.577377 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.db.resource_extend [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 21 13:51:40.586151 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 1.3171721 Nov 21 13:51:40.589434 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port 6ba2a400-da82-40d5-8543-00a95b3ae29e, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=6ba2a400-da82-40d5-8543-00a95b3ae29e,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:51:40.591119 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 24c864ef-5c5a-4df8-8968-78a7fe30b188 details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:51:40.591296 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 48430) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:40.598157 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.610505 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-6b9cb41b-672f-414d-b49c-d276398e6dc3 admin admin] Request body: {'subnet': {'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-subnet', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:40.615656 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.617003 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:40.617988 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.631528 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.633009 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:40.634126 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.636344 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe67405c-a568-4d13-acb1-87176012ee47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f54dc64-b6a0-4ca7-9ae7-78927108af9d,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:40.660541 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.4219201 Nov 21 13:51:40.662059 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48432) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:40.710917 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-154ad8ce-fbc3-4997-b51c-ed98368317ee admin admin] Request body: {'subnet': {'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-367439327-subnet', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:40.757398 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07984200-e867-49e0-a305-1f07ab055dfb admin admin] Pushing event updated for resources: {'Network': ['ID=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:40.780726 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:51:40.805084 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b9cb41b-672f-414d-b49c-d276398e6dc3 admin admin] Made reservation on behalf of 3d25ecbdc2ba435488271022d897a406 for: {'subnet': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:51:40.807346 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6b9cb41b-672f-414d-b49c-d276398e6dc3 admin admin] Publish callbacks [] for subnet, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:40.888139 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7981ea65-be31-4253-b574-8663c941afa6 None None] Network ea19090b-8034-4904-8b6c-1752befe0b5a requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:51:40.917961 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.8905108 Nov 21 13:51:40.929506 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48434) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:40.956966 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-78f74eff-7b95-4eed-8f76-709927b6b28d admin admin] Request body: {'subnet': {'network_id': '33b4c37c-dd9e-42d3-8c27-369177f4f9a2', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1614135741-subnet', 'tenant_id': 'c54a1970861a4e2eb50657ea8e7e5a0f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:40.975702 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5c16069-fda2-4676-b355-2b7c29762065 admin admin] Pushing event updated for resources: {'Network': ['ID=33b4c37c-dd9e-42d3-8c27-369177f4f9a2,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:41.008981 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-154ad8ce-fbc3-4997-b51c-ed98368317ee admin admin] Made reservation on behalf of c90104f2696540809e93549d7ed3695f for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:51:41.017072 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-154ad8ce-fbc3-4997-b51c-ed98368317ee admin admin] Publish callbacks [] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:41.030218 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-473263', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-468275'] for router, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:41.062286 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=6ba2a400-da82-40d5-8543-00a95b3ae29e,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:41.089515 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 33b4c37c-dd9e-42d3-8c27-369177f4f9a2 details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:51:41.118799 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-78f74eff-7b95-4eed-8f76-709927b6b28d admin admin] Made reservation on behalf of c54a1970861a4e2eb50657ea8e7e5a0f for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:51:41.122532 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-78f74eff-7b95-4eed-8f76-709927b6b28d admin admin] Publish callbacks [] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:41.224601 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-daca7fce-bd15-4e37-9161-d8309c1e6e2f None None] Provisioning complete for port 6ba2a400-da82-40d5-8543-00a95b3ae29e triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:41.225291 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-daca7fce-bd15-4e37-9161-d8309c1e6e2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:41.325452 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6b9cb41b-672f-414d-b49c-d276398e6dc3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for subnet, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:41.453837 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Router 65d15860-a1d7-449d-b2d9-7210d0a1d10b is scheduled to L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 with binding_index 1 {{(pid=109040) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 21 13:51:41.466630 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9cb41b-672f-414d-b49c-d276398e6dc3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c4887ea6-9c0e-4a7b-bd51-d70b335ceb92,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:41.477487 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b9cb41b-672f-414d-b49c-d276398e6dc3 admin admin] Checking segment: {'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109040) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:51:41.478184 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b9cb41b-672f-414d-b49c-d276398e6dc3 admin admin] Network hostable DHCP agents. Network: 24c864ef-5c5a-4df8-8968-78a7fe30b188, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109040) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:51:41.607222 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b9cb41b-672f-414d-b49c-d276398e6dc3 admin admin] Network 24c864ef-5c5a-4df8-8968-78a7fe30b188 is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109040) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:51:41.671478 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-6b9cb41b-672f-414d-b49c-d276398e6dc3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 24c864ef-5c5a-4df8-8968-78a7fe30b188) {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:41.673911 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-154ad8ce-fbc3-4997-b51c-ed98368317ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:41.678575 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b9cb41b-672f-414d-b49c-d276398e6dc3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:41.679203 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6b9cb41b-672f-414d-b49c-d276398e6dc3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:41.704996 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:51:41.720414 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Sync routers for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:51:41.720950 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d324c3bd-9629-4ffe-8b0a-b5efec375aff None None] Network 24c864ef-5c5a-4df8-8968-78a7fe30b188 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:51:41.731319 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48482) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:41.732024 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-154ad8ce-fbc3-4997-b51c-ed98368317ee admin admin] Pushing event updated for resources: {'Subnet': ['ID=a7f1c544-97e5-450d-9032-daf1d5a3a2a3,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:41.733863 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-6b9cb41b-672f-414d-b49c-d276398e6dc3 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 1.1386204 Nov 21 13:51:41.735620 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 48484) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:41.737817 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:41.739478 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:51:41.743277 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:51:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:41.751975 dv-cinder-768458-12-iscsi neutron-server[109040]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 21 13:51:41.783857 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-78f74eff-7b95-4eed-8f76-709927b6b28d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:41.891419 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f74eff-7b95-4eed-8f76-709927b6b28d admin admin] Pushing event updated for resources: {'Subnet': ['ID=4c2d478e-ba80-4e57-b9b6-adfcd28cac85,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:41.933456 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6b3ed262-49ce-5e18-b10a-0ddd25bea067-24c864ef-5c5a-4df8-8968-78a7fe30b188', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92'}]}} from dv-cinder-768458-12-iscsi. {{(pid=109042) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 21 13:51:41.936712 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:41.947278 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-154ad8ce-fbc3-4997-b51c-ed98368317ee admin admin] Checking segment: {'id': '87188554-865b-4f60-ac47-7f9dc768573f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:51:41.947615 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-154ad8ce-fbc3-4997-b51c-ed98368317ee admin admin] Network hostable DHCP agents. Network: 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:51:41.949766 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-408660', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-58304'] for router, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:41.951124 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-473172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-468334', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1610115', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-58419'] for router, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:41.959061 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] Publish callbacks [] for router, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:41.960434 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-2f75fbae-cd23-40e0-8cf2-a1eedd19d909 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 3.6683595 Nov 21 13:51:41.974551 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 48486) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:41.988041 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 6ba2a400-da82-40d5-8543-00a95b3ae29e up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:51:42.060645 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:42.152059 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-154ad8ce-fbc3-4997-b51c-ed98368317ee admin admin] Network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:51:42.157351 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-78f74eff-7b95-4eed-8f76-709927b6b28d admin admin] Checking segment: {'id': 'dff676ee-13c7-426c-b4e3-70ecdefc73be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 527, 'network_id': '33b4c37c-dd9e-42d3-8c27-369177f4f9a2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:51:42.157708 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78f74eff-7b95-4eed-8f76-709927b6b28d admin admin] Network hostable DHCP agents. Network: 33b4c37c-dd9e-42d3-8c27-369177f4f9a2, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:51:42.171657 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-154ad8ce-fbc3-4997-b51c-ed98368317ee admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:42.190390 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-154ad8ce-fbc3-4997-b51c-ed98368317ee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:42.197003 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-154ad8ce-fbc3-4997-b51c-ed98368317ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:42.236793 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cfcb2176-1152-4954-bea8-113fcdf0cd1f None None] Network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:51:42.319720 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-a2757a04-3f9d-4b52-b7a7-33ea776f4649 None None] Provisioning complete for port 6ba2a400-da82-40d5-8543-00a95b3ae29e triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:42.320408 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:51:42.320672 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-a2757a04-3f9d-4b52-b7a7-33ea776f4649 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:42.437130 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 6ba2a400-da82-40d5-8543-00a95b3ae29e triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:42.437130 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:42.471068 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.db_base_plugin_common [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Allocated IP 172.20.0.2 (24c864ef-5c5a-4df8-8968-78a7fe30b188/c4887ea6-9c0e-4a7b-bd51-d70b335ceb92/da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff) {{(pid=109042) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:51:42.606091 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-4d0e6a09-3172-4c0f-8f7d-d7db6bb0d6c5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:42.618131 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-4d0e6a09-3172-4c0f-8f7d-d7db6bb0d6c5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/networks?id=329f6f8a-93b1-430a-8c57-dacb018278ff HTTP/1.1" status: 200 len: 812 time: 0.8663497 Nov 21 13:51:42.656715 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:42.677731 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-154ad8ce-fbc3-4997-b51c-ed98368317ee admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 1.9877043 Nov 21 13:51:42.679279 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78f74eff-7b95-4eed-8f76-709927b6b28d admin admin] Network 33b4c37c-dd9e-42d3-8c27-369177f4f9a2 is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:51:42.680551 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 48506) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:42.685186 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-367439327-router', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:42.693932 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b46b8d78-0d31-4e5e-93ae-b458e0170f94 None None] Network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:51:42.696351 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-78f74eff-7b95-4eed-8f76-709927b6b28d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 33b4c37c-dd9e-42d3-8c27-369177f4f9a2) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:42.702007 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-67670293-645f-41b7-bd4b-866834cce14a tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/quotas/9580a66e32944e649fafe038a1d4cc4a HTTP/1.1" status: 200 len: 375 time: 0.0531240 Nov 21 13:51:42.763239 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78f74eff-7b95-4eed-8f76-709927b6b28d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:42.763865 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-78f74eff-7b95-4eed-8f76-709927b6b28d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:42.811509 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:40Z', 'revision_number': 3, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:42.819176 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-78585077-20e7-4fca-bb00-0c29b39b8bbe tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=9580a66e32944e649fafe038a1d4cc4a&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1159239 Nov 21 13:51:42.845864 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-408660', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-58304'] for router, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:42.846946 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-473172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-468334', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1610115', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-58419'] for router, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:42.859185 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-78f74eff-7b95-4eed-8f76-709927b6b28d admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.9282880 Nov 21 13:51:42.883521 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Checking router: 65d15860-a1d7-449d-b2d9-7210d0a1d10b for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:51:42.883916 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Updating router 65d15860-a1d7-449d-b2d9-7210d0a1d10b port 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca binding host dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:51:42.951176 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:43.056355 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Publish callbacks [] for port, precommit_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:43.092179 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:43.093545 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f2eb8e1-92dd-4f5a-a183-8be4b86c70b7 None None] Network 33b4c37c-dd9e-42d3-8c27-369177f4f9a2 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:51:43.106566 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:43.138980 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:43.170422 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:43.331705 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Network 24c864ef-5c5a-4df8-8968-78a7fe30b188 is already hosted by enough agents. {{(pid=109042) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:51:43.339637 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Pushing event updated for resources: {'Port': ['ID=da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff,revision_number=1']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:43.372258 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.base_scheduler [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Resources bound (agent type, host, resource id): {{(pid=109042) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:43.373722 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Allocated IP 172.27.1.196 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/eda329ac-a209-4da8-b74f-a5e6cc6eb19c) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:51:43.385937 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Received port after_create {{(pid=109042) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:51:43.498946 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Attempting to bind port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:51:43.499326 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Attempting to bind port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:51:43.499700 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Attempting to bind port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff on network 24c864ef-5c5a-4df8-8968-78a7fe30b188 {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:51:43.507476 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 51, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:51:43.507987 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Checking segment: {'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:51:43.508314 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:43.508672 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Bound using segment: {'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:51:43.509214 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Bound port: da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:51:43.509933 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:43.520161 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9adb594-18fd-44c9-ab81-8d96771e6ce1 None None] Network 33b4c37c-dd9e-42d3-8c27-369177f4f9a2 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:51:43.540832 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-808001fd-afe1-4339-a25e-3f7fc8398621 service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109040) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 13:51:43.542202 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-808001fd-afe1-4339-a25e-3f7fc8398621 service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.4397213 Nov 21 13:51:43.616755 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:51:43.637739 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:43.649204 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] For port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:51:43.680502 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] For port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:51:43.682147 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48554) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:43.698313 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:43.700792 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:43.749794 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:43.837545 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-112c74d0-a177-4768-8f50-dd9aca46db3e None None] Pushing event updated for resources: {'Port': ['ID=da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:43.884781 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Pushing event updated for resources: {'Port': ['ID=eda329ac-a209-4da8-b74f-a5e6cc6eb19c,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:43.892618 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:43.935647 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:51:43.939565 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:43.947653 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:51:43.996070 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Publish callbacks [] for port, precommit_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:44.004829 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:44.062248 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Pushing event updated for resources: {'Port': ['ID=4b6ebcd5-75f1-45dd-b6a3-3a4972744dca,revision_number=2']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:44.078068 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:44.078877 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:44.079473 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:44.080168 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:44.080704 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:44.081356 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-5315a2dc-e6df-4935-afa5-d613bba02184 service neutron] 10.222.0.11 "GET /v2.0/networks/329f6f8a-93b1-430a-8c57-dacb018278ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4487545 Nov 21 13:51:44.082096 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:44.083017 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:44.083695 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:44.084392 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:44.084885 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:44.085446 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:44.086226 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Tracked resource versions report: Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: pushed versions: Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: { 'AddressGroup': {'1.2'}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'ConntrackHelper': {'1.0'}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Log': {'1.0'}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Network': {'1.1'}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Port': {'1.7'}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'PortForwarding': {'1.2'}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'QosPolicy': {'1.10'}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'SecurityGroup': {'1.5'}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'SecurityGroupRule': {'1.2'}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'SubPort': {'1.0'}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Subnet': {'1.1'}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Trunk': {'1.1'}} Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: consumer versions: Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: { DHCP agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: HyperV agent@hv-cinder-76845: {}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: L3 agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: Metadata agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: Metering agent@dv-cinder-768458-12-iscsi: {}, Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: Open vSwitch agent@dv-cinder-768458-12-iscsi: { 'AddressGroup': '1.2', Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'ConntrackHelper': '1.0', Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Log': '1.0', Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Network': '1.1', Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Port': '1.7', Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'PortForwarding': '1.2', Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'QosPolicy': '1.10', Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'SecurityGroup': '1.5', Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'SecurityGroupRule': '1.2', Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'SubPort': '1.0', Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Subnet': '1.1', Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: 'Trunk': '1.1'}} Nov 21 13:51:44.087794 dv-cinder-768458-12-iscsi neutron-server[109043]: {{(pid=109043) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 21 13:51:44.150715 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Attempting to bind port 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:51:44.150715 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Attempting to bind port 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:51:44.150715 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Attempting to bind port 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca on network 67069811-a3d5-4953-8a57-e62d44750fe3 {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:51:44.158197 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 51, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:51:44.158582 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Checking segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109043) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:51:44.158999 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:44.159404 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Bound using segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:51:44.159922 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Bound port: 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:51:44.160313 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:44.171311 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a136db14-fa0b-428d-bf07-9857352174ff admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:44.246647 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] For port 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109043) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:51:44.251663 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] For port 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=4b6ebcd5-75f1-45dd-b6a3-3a4972744dca,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109043) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:51:44.258289 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:44.356423 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f6dafc6-c0dd-4d86-984d-a639c891b2b8 None None] Pushing event updated for resources: {'Port': ['ID=4b6ebcd5-75f1-45dd-b6a3-3a4972744dca,revision_number=3']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:44.359146 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:51:44.359976 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:51:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:44.414758 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48574) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:44.423250 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1494486048-network', 'tenant_id': '19952e1872394e048256134f4e6b5093'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:44.441859 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Allocated IP 172.20.0.1 (ea19090b-8034-4904-8b6c-1752befe0b5a/8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0/b90c7b7c-6c07-46d3-a05c-f48dfaf5adea) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:51:44.462719 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-cde5a1d7-1e35-4c3d-8df8-c2bfe56a5c3e service neutron] 10.222.0.11 "GET /v2.0/networks/329f6f8a-93b1-430a-8c57-dacb018278ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3804331 Nov 21 13:51:44.502371 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a136db14-fa0b-428d-bf07-9857352174ff admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:44.514368 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a136db14-fa0b-428d-bf07-9857352174ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:44.529015 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:44.536694 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:51:44.546476 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Made reservation on behalf of 19952e1872394e048256134f4e6b5093 for: {'network': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:51:44.546476 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:44.634898 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:44.648851 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-a136db14-fa0b-428d-bf07-9857352174ff admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=d49c61baf9c1400eaea73f57432c4e03&name=default HTTP/1.1" status: 200 len: 2992 time: 0.9632263 Nov 21 13:51:44.655671 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48586) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:44.658354 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a136db14-fa0b-428d-bf07-9857352174ff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=09442f88-7d26-4c44-b1a6-1b0717bc6e2d,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:44.889267 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:40Z', 'revision_number': 3, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:44.953647 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c1ca5ae6-8caf-48f7-a8ad-126f22256e2f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:44.959950 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09552342-4240-48c0-86d6-ae6d49101d90 None None] The sync data for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi is: [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:40Z', 'revision_number': 3, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:51:45.012299 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-aacd00c5-e729-4b09-9bfe-76a856645b9d req-8980dbd9-ed43-4c5a-9706-0fca44a2ec61 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 210 time: 0.1245527 Nov 21 13:51:45.017534 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.040551 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.050247 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.084355 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.090594 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c1ca5ae6-8caf-48f7-a8ad-126f22256e2f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.094016 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.158674 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] vlan segment allocate from pool success with {'vlan_id': 520, 'physical_network': 'physnet1'} {{(pid=109041) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:51:45.217867 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.241911 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59101f72-6403-48de-94ce-d451db5cd9cb,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:45.262538 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.262892 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.segments_db [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Added segment 7b95fc2f-446e-45af-b924-6894dc421a58 of type vlan for network 07806d11-3b4d-4c2d-8124-8d2dd3e34737 Nov 21 13:51:45.279747 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-473263', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-468275'] for router, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.419776 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Network ea19090b-8034-4904-8b6c-1752befe0b5a is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:51:45.433091 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:45.441970 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:51:45.442814 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-470894'] for router_interface, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.457408 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6310e118-8bcb-4e0f-9e51-61d5b0df4265 None None] Network 24c864ef-5c5a-4df8-8968-78a7fe30b188 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:51:45.462752 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.508705 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.509670 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:45.510271 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.579465 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Pushing event updated for resources: {'Port': ['ID=b90c7b7c-6c07-46d3-a05c-f48dfaf5adea,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:45.614655 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] Pushing event updated for resources: {'Network': ['ID=07806d11-3b4d-4c2d-8124-8d2dd3e34737,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:45.621142 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c1ca5ae6-8caf-48f7-a8ad-126f22256e2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.623960 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c1ca5ae6-8caf-48f7-a8ad-126f22256e2f admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.625313 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-c1ca5ae6-8caf-48f7-a8ad-126f22256e2f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/09442f88-7d26-4c44-b1a6-1b0717bc6e2d HTTP/1.1" status: 204 len: 168 time: 0.9683118 Nov 21 13:51:45.683183 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Allocated IP 172.27.1.84 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/32a7269f-aa91-4f48-a140-c832f7cbd2f2) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:51:45.720439 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-1fe46d61-5787-48a0-9e3f-b9b01877a05c admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.3043585 Nov 21 13:51:45.721111 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48626) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:45.733671 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ca5ae6-8caf-48f7-a8ad-126f22256e2f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=09442f88-7d26-4c44-b1a6-1b0717bc6e2d,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:45.741438 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-202ed0fe-1e41-42ca-8a12-fa8dce00d7f5 admin admin] Request body: {'subnet': {'network_id': '07806d11-3b4d-4c2d-8124-8d2dd3e34737', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1494486048-subnet', 'tenant_id': '19952e1872394e048256134f4e6b5093', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:45.769118 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-202ed0fe-1e41-42ca-8a12-fa8dce00d7f5 admin admin] Made reservation on behalf of 19952e1872394e048256134f4e6b5093 for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:51:45.772287 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-202ed0fe-1e41-42ca-8a12-fa8dce00d7f5 admin admin] Publish callbacks [] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:45.987601 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 07806d11-3b4d-4c2d-8124-8d2dd3e34737 details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:51:45.998261 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Router 0f049428-3827-4a0f-9254-57ee6dba40c0 is scheduled to L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 with binding_index 1 {{(pid=109041) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 21 13:51:46.070450 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:46.105725 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-e4c2fe40-93e5-4c2f-a975-8e0cc0ad2b13 None None] Provisioning complete for port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:46.106463 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e4c2fe40-93e5-4c2f-a975-8e0cc0ad2b13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:46.172479 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:51:46.206302 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:46.242373 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8efdc7b1-008c-42db-9610-42da225621e5 req-a015f5c0-ab08-4e68-859f-1a7696e10a6e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 210 time: 0.0842183 Nov 21 13:51:46.387450 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e4c2fe40-93e5-4c2f-a975-8e0cc0ad2b13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:46.451933 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-e4c2fe40-93e5-4c2f-a975-8e0cc0ad2b13 None None] For port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:51:46.453245 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:46.453665 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:46.487657 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:46.499392 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e4c2fe40-93e5-4c2f-a975-8e0cc0ad2b13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:46.569987 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-202ed0fe-1e41-42ca-8a12-fa8dce00d7f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:46.585063 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4c2fe40-93e5-4c2f-a975-8e0cc0ad2b13 None None] Pushing event updated for resources: {'Port': ['ID=da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:46.639287 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:51:46.647564 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-202ed0fe-1e41-42ca-8a12-fa8dce00d7f5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=48465f7b-16da-4c58-b1f8-0f6fd989a7cb,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:46.659652 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:46.659897 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:51:46.693760 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Sync routers for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:51:46.696453 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] Publish callbacks [] for router, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:46.703212 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-5288d0f6-97e8-420b-8e31-01c43262b35b admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 4.9662690 Nov 21 13:51:46.704751 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:51:46.706562 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 48658) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:46.711241 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-202ed0fe-1e41-42ca-8a12-fa8dce00d7f5 admin admin] Checking segment: {'id': '7b95fc2f-446e-45af-b924-6894dc421a58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 520, 'network_id': '07806d11-3b4d-4c2d-8124-8d2dd3e34737'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:51:46.711789 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-202ed0fe-1e41-42ca-8a12-fa8dce00d7f5 admin admin] Network hostable DHCP agents. Network: 07806d11-3b4d-4c2d-8124-8d2dd3e34737, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:51:46.732949 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:51:46.733592 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:51:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:46.742540 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-202ed0fe-1e41-42ca-8a12-fa8dce00d7f5 admin admin] Network 07806d11-3b4d-4c2d-8124-8d2dd3e34737 is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:51:46.757280 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-202ed0fe-1e41-42ca-8a12-fa8dce00d7f5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 07806d11-3b4d-4c2d-8124-8d2dd3e34737) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:46.763878 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-202ed0fe-1e41-42ca-8a12-fa8dce00d7f5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:46.765525 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-202ed0fe-1e41-42ca-8a12-fa8dce00d7f5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:46.796327 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-202ed0fe-1e41-42ca-8a12-fa8dce00d7f5 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.0574141 Nov 21 13:51:46.847446 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:51:46.886740 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Pushing event updated for resources: {'Port': ['ID=32a7269f-aa91-4f48-a140-c832f7cbd2f2,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:46.918058 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e23d820-0745-461f-a47e-313d01c29d63 None None] Network 07806d11-3b4d-4c2d-8124-8d2dd3e34737 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:51:46.946134 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48674) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:46.965158 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.012596 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_v2 [None req-26fb7d9d-0cc5-4a0b-92da-925d1045bcef admin admin] Deleting subnet 4c2d478e-ba80-4e57-b9b6-adfcd28cac85 {{(pid=109041) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 13:51:47.016764 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-26fb7d9d-0cc5-4a0b-92da-925d1045bcef admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.059105 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.060326 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1684480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-473342'] for router_interface, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.068033 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-26fb7d9d-0cc5-4a0b-92da-925d1045bcef admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.078343 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-7e0352ce-1e91-4950-aba2-dda287c31acf None None] Provisioning complete for port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:47.078717 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-7e0352ce-1e91-4950-aba2-dda287c31acf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.078939 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-26fb7d9d-0cc5-4a0b-92da-925d1045bcef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.117172 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-7e0352ce-1e91-4950-aba2-dda287c31acf None None] Port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:51:47.119636 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:51:47.146091 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-26fb7d9d-0cc5-4a0b-92da-925d1045bcef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for subnet, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.164108 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-26fb7d9d-0cc5-4a0b-92da-925d1045bcef admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.171882 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-26fb7d9d-0cc5-4a0b-92da-925d1045bcef admin admin] 10.222.0.11 "DELETE /v2.0/subnets/4c2d478e-ba80-4e57-b9b6-adfcd28cac85 HTTP/1.1" status: 204 len: 168 time: 0.2247646 Nov 21 13:51:47.184273 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Pushing event updated for resources: {'Port': ['ID=b90c7b7c-6c07-46d3-a05c-f48dfaf5adea,revision_number=2']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:47.193960 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48678) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:47.280932 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.287646 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26fb7d9d-0cc5-4a0b-92da-925d1045bcef admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4c2d478e-ba80-4e57-b9b6-adfcd28cac85,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:47.299346 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6c49ebe-0e4f-44bc-a3d5-bd067a3139cf None None] Network 07806d11-3b4d-4c2d-8124-8d2dd3e34737 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:51:47.416867 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.450369 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.450727 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.451488 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.451835 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > port after_create 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.452399 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > port after_delete 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.453309 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > port after_update 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.453654 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.454745 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.454745 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.454745 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.479449 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:47.479964 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.663221 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.677820 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-72c3056f-a909-46e5-9415-e006245cd616 None None] Provisioning complete for port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:47.678175 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-72c3056f-a909-46e5-9415-e006245cd616 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.709119 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:44Z', 'revision_number': 3, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:47.727741 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=4b6ebcd5-75f1-45dd-b6a3-3a4972744dca,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:51:47.740796 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7305f776-9e6b-416d-b34f-dd443ef35c0b req-967665a0-4c3f-4e3e-bba0-b82dc44b3238 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 210 time: 0.1580386 Nov 21 13:51:47.756275 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.758055 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Checking router: 0f049428-3827-4a0f-9254-57ee6dba40c0 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:51:47.758410 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Updating router 0f049428-3827-4a0f-9254-57ee6dba40c0 port eda329ac-a209-4da8-b74f-a5e6cc6eb19c binding host dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:51:47.874799 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.875747 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.876430 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.876910 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=109041) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:51:47.877448 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['33b4c37c-dd9e-42d3-8c27-369177f4f9a2']}} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:47.879990 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=4b6ebcd5-75f1-45dd-b6a3-3a4972744dca,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:47.891080 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.921215 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dff676ee-13c7-426c-b4e3-70ecdefc73be') {'for_net_delete': True} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:47.921435 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dff676ee-13c7-426c-b4e3-70ecdefc73be') {} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:47.928112 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Network ea19090b-8034-4904-8b6c-1752befe0b5a is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:51:47.933122 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:47.944733 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4028979'] for segment, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.953947 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.972896 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:47.985829 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Releasing vlan 527 on physical network physnet1 to pool {{(pid=109041) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 13:51:47.986550 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3087018'] for segment, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: from cryptography.utils import int_from_bytes Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: from cryptography.utils import int_from_bytes Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: Traceback (most recent call last): Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: timer() Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: cb(*args, **kw) Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: return func(*args, **kwargs) Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: self._notify() Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: self.callback(batched_events) Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: event.method(event) Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: return f(self, *a, **k) Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._get(url).json() Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: return self.request(url, 'GET', **kwargs) Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 13:51:48.069859 dv-cinder-768458-12-iscsi neutron-server[109041]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 13:51:48.109904 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.136925 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Pushing event deleted for resources: {'Network': ['ID=33b4c37c-dd9e-42d3-8c27-369177f4f9a2,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:48.155671 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.162934 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-b317ccbe-a5e8-417a-861b-8073c3e7a138 admin admin] 10.222.0.11 "DELETE /v2.0/networks/33b4c37c-dd9e-42d3-8c27-369177f4f9a2 HTTP/1.1" status: 204 len: 168 time: 0.9661460 Nov 21 13:51:48.164961 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48708) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:48.253374 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_v2 [None req-c1dcd9fb-e062-4220-a4a1-818669523d85 admin admin] Deleting subnet 48465f7b-16da-4c58-b1f8-0f6fd989a7cb {{(pid=109041) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 13:51:48.260079 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c1dcd9fb-e062-4220-a4a1-818669523d85 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.296515 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.305032 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:51:48.331225 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c1dcd9fb-e062-4220-a4a1-818669523d85 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4028984'] for subnet, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.393499 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Router 65d15860-a1d7-449d-b2d9-7210d0a1d10b has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:51:48.399823 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c1dcd9fb-e062-4220-a4a1-818669523d85 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.528984 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c1dcd9fb-e062-4220-a4a1-818669523d85 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3086848', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261005199'] for subnet, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.564054 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1dcd9fb-e062-4220-a4a1-818669523d85 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=48465f7b-16da-4c58-b1f8-0f6fd989a7cb,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:48.584178 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c1dcd9fb-e062-4220-a4a1-818669523d85 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.594395 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-c1dcd9fb-e062-4220-a4a1-818669523d85 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/48465f7b-16da-4c58-b1f8-0f6fd989a7cb HTTP/1.1" status: 204 len: 168 time: 0.4258835 Nov 21 13:51:48.594634 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48728) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:48.605389 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:48.605904 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.696175 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-473263', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-468275'] for router, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.710264 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-461ebfe7-c8e5-42f0-a02c-dfff8b590447 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.745151 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-bddc2471-34d5-4118-a3b0-6371c7c418d6 None None] Provisioning complete for port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:48.745721 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-bddc2471-34d5-4118-a3b0-6371c7c418d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.802519 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-bddc2471-34d5-4118-a3b0-6371c7c418d6 None None] Port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:51:48.921629 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-461ebfe7-c8e5-42f0-a02c-dfff8b590447 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.945532 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Publish callbacks [] for port, precommit_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.971734 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:48.992276 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-461ebfe7-c8e5-42f0-a02c-dfff8b590447 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07806d11-3b4d-4c2d-8124-8d2dd3e34737']}} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:49.011491 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-461ebfe7-c8e5-42f0-a02c-dfff8b590447 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7b95fc2f-446e-45af-b924-6894dc421a58') {'for_net_delete': True} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:49.011616 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-461ebfe7-c8e5-42f0-a02c-dfff8b590447 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7b95fc2f-446e-45af-b924-6894dc421a58') {} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:49.021309 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.50', 61769) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:49.041321 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-461ebfe7-c8e5-42f0-a02c-dfff8b590447 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4028979'] for segment, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:49.063844 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20cc83d3-134a-41fc-9d65-4bf2c1300672 None None] Pushing event updated for resources: {'Port': ['ID=eda329ac-a209-4da8-b74f-a5e6cc6eb19c,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:49.099652 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Attempting to bind port eda329ac-a209-4da8-b74f-a5e6cc6eb19c on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:51:49.100080 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Attempting to bind port eda329ac-a209-4da8-b74f-a5e6cc6eb19c by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:51:49.100456 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Attempting to bind port eda329ac-a209-4da8-b74f-a5e6cc6eb19c on network 67069811-a3d5-4953-8a57-e62d44750fe3 {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:51:49.109810 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 51, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:51:49.110237 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Checking segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:51:49.110747 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:49.111242 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Bound using segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:51:49.111799 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Bound port: eda329ac-a209-4da8-b74f-a5e6cc6eb19c, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:51:49.112501 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:49.185336 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-461ebfe7-c8e5-42f0-a02c-dfff8b590447 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:49.192133 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-461ebfe7-c8e5-42f0-a02c-dfff8b590447 admin admin] Releasing vlan 520 on physical network physnet1 to pool {{(pid=109041) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 13:51:49.192675 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-461ebfe7-c8e5-42f0-a02c-dfff8b590447 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3087018'] for segment, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:49.220290 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] For port eda329ac-a209-4da8-b74f-a5e6cc6eb19c, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:51:49.231584 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] For port eda329ac-a209-4da8-b74f-a5e6cc6eb19c, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=eda329ac-a209-4da8-b74f-a5e6cc6eb19c,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:51:49.243228 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: Traceback (most recent call last): Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: timer() Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: cb(*args, **kw) Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: return func(*args, **kwargs) Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: self._notify() Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: self.callback(batched_events) Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: event.method(event) Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: return f(self, *a, **k) Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._get(url).json() Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: return self.request(url, 'GET', **kwargs) Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 13:51:49.250280 dv-cinder-768458-12-iscsi neutron-server[109041]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 13:51:49.280351 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-461ebfe7-c8e5-42f0-a02c-dfff8b590447 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:49.306137 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-461ebfe7-c8e5-42f0-a02c-dfff8b590447 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:49.311858 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-461ebfe7-c8e5-42f0-a02c-dfff8b590447 admin admin] 10.222.0.11 "DELETE /v2.0/networks/07806d11-3b4d-4c2d-8124-8d2dd3e34737 HTTP/1.1" status: 204 len: 168 time: 0.7135623 Nov 21 13:51:49.367569 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:51:49.367569 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:51:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:49.426958 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f4e56192-d971-4115-95f1-2e3d4612601f req-923c1e72-a10e-4677-aba1-3a99ad8b76f7 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 210 time: 0.1523545 Nov 21 13:51:49.442101 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-461ebfe7-c8e5-42f0-a02c-dfff8b590447 admin admin] Pushing event deleted for resources: {'Network': ['ID=07806d11-3b4d-4c2d-8124-8d2dd3e34737,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:49.506200 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-e36fa725-d570-4571-a44e-46850e2e1394 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:49.507947 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-e36fa725-d570-4571-a44e-46850e2e1394 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.50 "GET /v2.0/networks?id=329f6f8a-93b1-430a-8c57-dacb018278ff HTTP/1.1" status: 200 len: 812 time: 0.4817543 Nov 21 13:51:49.509093 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20cc83d3-134a-41fc-9d65-4bf2c1300672 None None] Pushing event updated for resources: {'Port': ['ID=eda329ac-a209-4da8-b74f-a5e6cc6eb19c,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:49.540043 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:51:49.545965 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-e89b9649-7319-4515-9a61-3fd4132ec1bd admin admin] 10.222.0.11 "PUT /v2.0/routers/65d15860-a1d7-449d-b2d9-7210d0a1d10b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.5701709 Nov 21 13:51:49.557628 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48782) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:49.558409 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Sync routers for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:51:49.570270 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Allocated IP 172.20.0.1 (24c864ef-5c5a-4df8-8968-78a7fe30b188/c4887ea6-9c0e-4a7b-bd51-d70b335ceb92/352f29a9-b7fa-46f1-bcc4-584ce9176e66) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:51:49.574324 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:51:49.574986 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:51:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:49.624517 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:51:49.626269 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-99c63ac4-42c4-4b9e-b3b3-616fab64e663 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Request body: {'port': {'device_id': 'f7ac629e-e375-4954-82d0-1efb9da7da3b', 'network_id': '329f6f8a-93b1-430a-8c57-dacb018278ff', 'admin_state_up': True, 'tenant_id': '9580a66e32944e649fafe038a1d4cc4a'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:49.839746 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:49.850088 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-c0bab068-70c8-4cae-9db0-40d88b6dc300 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=c54a1970861a4e2eb50657ea8e7e5a0f&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2911992 Nov 21 13:51:49.926810 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 48800) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:49.954642 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:51:50.009015 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:50.016533 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:51:50.045889 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Network 24c864ef-5c5a-4df8-8968-78a7fe30b188 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:51:50.047160 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Router 33e387fa-f34a-4ac8-9676-eb7f363972f4 is scheduled to L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 with binding_index 1 {{(pid=109040) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 21 13:51:50.107936 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:50.129849 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Pushing event updated for resources: {'Port': ['ID=352f29a9-b7fa-46f1-bcc4-584ce9176e66,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:50.159708 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:51:50.160873 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-470894'] for router_interface, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:50.218258 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:50.228486 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:50.266339 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-99c63ac4-42c4-4b9e-b3b3-616fab64e663 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Made reservation on behalf of 9580a66e32944e649fafe038a1d4cc4a for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:51:50.282589 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-00c165c1-86b6-44ba-a77d-8b100c7ffaa9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:50.283647 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-99c63ac4-42c4-4b9e-b3b3-616fab64e663 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:50.334055 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:44Z', 'revision_number': 3, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:50.338858 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:46Z', 'revision_number': 2, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:50.469723 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Checking router: 65d15860-a1d7-449d-b2d9-7210d0a1d10b for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:51:50.471785 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Updating router 65d15860-a1d7-449d-b2d9-7210d0a1d10b port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea binding host dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:51:50.505429 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f7067aa-4133-42c8-9a6a-54faaaa6d226 None None] The sync data for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi is: [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:44Z', 'revision_number': 3, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:51:50.552176 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-00c165c1-86b6-44ba-a77d-8b100c7ffaa9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:50.652642 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:50.711971 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:51:50.751523 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Sync routers for ids ['33e387fa-f34a-4ac8-9676-eb7f363972f4'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:51:50.804469 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-357d9b71-0536-422d-a3bf-16461c81965f None None] Provisioning complete for port 352f29a9-b7fa-46f1-bcc4-584ce9176e66 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:50.805252 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-357d9b71-0536-422d-a3bf-16461c81965f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:50.812278 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Routers {'33e387fa-f34a-4ac8-9676-eb7f363972f4'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:51:50.815889 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:51:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['33e387fa-f34a-4ac8-9676-eb7f363972f4'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:50.876630 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-895fc5d2-f8e2-47f0-973d-106a5139fa17 req-b99913a8-a2f2-4852-b5f0-c4b8ef8b95d6 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 210 time: 0.1606457 Nov 21 13:51:50.893246 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-00c165c1-86b6-44ba-a77d-8b100c7ffaa9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:50.909291 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-00c165c1-86b6-44ba-a77d-8b100c7ffaa9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:50.914316 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-00c165c1-86b6-44ba-a77d-8b100c7ffaa9 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/b710ded8-f848-4dbe-a8f0-f3e09e6065b0 HTTP/1.1" status: 204 len: 168 time: 0.9976606 Nov 21 13:51:50.966787 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] Publish callbacks [] for router, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:50.972131 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-07a70e26-a49d-434b-a675-302d0e736144 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 8.2905574 Nov 21 13:51:50.982247 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 48844) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:51.000181 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:51.092875 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00c165c1-86b6-44ba-a77d-8b100c7ffaa9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b710ded8-f848-4dbe-a8f0-f3e09e6065b0,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:51.103167 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Set router 33e387fa-f34a-4ac8-9676-eb7f363972f4 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:51:51.483456 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-357d9b71-0536-422d-a3bf-16461c81965f None None] Port 352f29a9-b7fa-46f1-bcc4-584ce9176e66 cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:51:51.498778 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'name': 'tempest-ServerRescueNegativeTestJSON-367439327-router', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:42Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 3, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'gw_port': {'id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:08:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:45Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:51.535299 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Checking router: 33e387fa-f34a-4ac8-9676-eb7f363972f4 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:51:51.535573 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Updating router 33e387fa-f34a-4ac8-9676-eb7f363972f4 port 32a7269f-aa91-4f48-a140-c832f7cbd2f2 binding host dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:51:51.585642 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:51.793992 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-99c63ac4-42c4-4b9e-b3b3-616fab64e663 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Allocated IP 172.20.0.4 (329f6f8a-93b1-430a-8c57-dacb018278ff/b2250609-3053-4cfc-afb4-7edd4f2f599d/8653e663-5da8-4b7e-91b0-8c94d45d51ad) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:51:52.124074 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device eda329ac-a209-4da8-b74f-a5e6cc6eb19c up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:51:52.216322 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48878) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:52.336256 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8b25fc35-f004-4cc1-ac70-26c1cd86330f req-ccf98a94-ebae-4bf5-9751-43f2278b4d33 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 210 time: 0.2015362 Nov 21 13:51:52.461773 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Publish callbacks [] for port, precommit_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:52.485766 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:52.559040 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48882) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:52.572477 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 48884) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:52.590524 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-ba9c3a5f-960b-4add-b7d1-fc0eebcecb6e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Request body: {'security_group': {'name': 'tempest-securitygroup--908046903', 'description': 'tempest-description--53355583'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:52.624526 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b05f533-d420-4bea-ad8d-3f5baef2e75d None None] Pushing event updated for resources: {'Port': ['ID=b90c7b7c-6c07-46d3-a05c-f48dfaf5adea,revision_number=3']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:52.643906 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-99c63ac4-42c4-4b9e-b3b3-616fab64e663 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:52.728935 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-ee71395c-994e-4699-aa56-798a731ecea2 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=19952e1872394e048256134f4e6b5093&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1645057 Nov 21 13:51:52.731452 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48888) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:52.865482 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Attempting to bind port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:51:52.870889 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Attempting to bind port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:51:52.872260 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Attempting to bind port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea on network ea19090b-8034-4904-8b6c-1752befe0b5a {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:51:52.884502 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 51, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:51:52.886771 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Checking segment: {'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109043) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:51:52.888595 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:52.891212 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Bound using segment: {'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:51:52.891987 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Bound port: b90c7b7c-6c07-46d3-a05c-f48dfaf5adea, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'}}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:51:52.892900 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:52.901935 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ba9c3a5f-960b-4add-b7d1-fc0eebcecb6e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:52.917427 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:52.926169 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-99c63ac4-42c4-4b9e-b3b3-616fab64e663 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:52.972509 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fd3904dc-a776-4e43-bf78-93e6872e29c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.068674 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port eda329ac-a209-4da8-b74f-a5e6cc6eb19c triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:53.069058 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.070360 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.099153 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.107665 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1684480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-473342'] for router_interface, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.124383 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] For port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109043) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:51:53.135307 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] For port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=b90c7b7c-6c07-46d3-a05c-f48dfaf5adea,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109043) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:51:53.147946 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.196641 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99c63ac4-42c4-4b9e-b3b3-616fab64e663 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Pushing event updated for resources: {'Port': ['ID=8653e663-5da8-4b7e-91b0-8c94d45d51ad,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:53.277795 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-99c63ac4-42c4-4b9e-b3b3-616fab64e663 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Network 329f6f8a-93b1-430a-8c57-dacb018278ff is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:51:53.278431 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Publish callbacks [] for port, precommit_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.281974 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:51:53.287622 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:51:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:53.324889 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-1a4ba0da-cac7-4f6e-9438-13c6f018a928 None None] Provisioning complete for port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:53.325574 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-1a4ba0da-cac7-4f6e-9438-13c6f018a928 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.341379 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.344966 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-99c63ac4-42c4-4b9e-b3b3-616fab64e663 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:53.430224 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-069aeceb-b41b-4448-abc2-911a2560d9e4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.471297 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fd3904dc-a776-4e43-bf78-93e6872e29c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.474479 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-99c63ac4-42c4-4b9e-b3b3-616fab64e663 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:51:53.521473 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Pushing event updated for resources: {'Port': ['ID=352f29a9-b7fa-46f1-bcc4-584ce9176e66,revision_number=2']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:53.605691 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:51:53.742310 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-069aeceb-b41b-4448-abc2-911a2560d9e4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.774019 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75f80f48-90b9-459c-ba59-89ffdcbece1a None None] Pushing event updated for resources: {'Port': ['ID=32a7269f-aa91-4f48-a140-c832f7cbd2f2,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:53.775199 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-069aeceb-b41b-4448-abc2-911a2560d9e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.799851 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Attempting to bind port 32a7269f-aa91-4f48-a140-c832f7cbd2f2 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:51:53.800298 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Attempting to bind port 32a7269f-aa91-4f48-a140-c832f7cbd2f2 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:51:53.800721 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Attempting to bind port 32a7269f-aa91-4f48-a140-c832f7cbd2f2 on network 67069811-a3d5-4953-8a57-e62d44750fe3 {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:51:53.822359 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.839524 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ba9c3a5f-960b-4add-b7d1-fc0eebcecb6e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.865610 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 51, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:51:53.865985 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Checking segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:51:53.866437 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.866917 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Bound using segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:51:53.867423 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Bound port: 32a7269f-aa91-4f48-a140-c832f7cbd2f2, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:51:53.867837 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.879725 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace0895d-3b3f-45db-92ba-602f9a379214 req-0bed4f46-3484-4a90-99a9-e4deb9e378c7 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:53.886642 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b05f533-d420-4bea-ad8d-3f5baef2e75d None None] Pushing event updated for resources: {'Port': ['ID=b90c7b7c-6c07-46d3-a05c-f48dfaf5adea,revision_number=4']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:53.889627 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ace0895d-3b3f-45db-92ba-602f9a379214 req-0bed4f46-3484-4a90-99a9-e4deb9e378c7 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 931 time: 0.3913236 Nov 21 13:51:53.891729 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ba9c3a5f-960b-4add-b7d1-fc0eebcecb6e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:53.922708 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-99c63ac4-42c4-4b9e-b3b3-616fab64e663 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:53.925079 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-99c63ac4-42c4-4b9e-b3b3-616fab64e663 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.011210 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port eda329ac-a209-4da8-b74f-a5e6cc6eb19c, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=eda329ac-a209-4da8-b74f-a5e6cc6eb19c,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:51:54.016786 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ba9c3a5f-960b-4add-b7d1-fc0eebcecb6e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.018506 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-ba9c3a5f-960b-4add-b7d1-fc0eebcecb6e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1793 time: 1.4319415 Nov 21 13:51:54.019483 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:54.022584 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Network 24c864ef-5c5a-4df8-8968-78a7fe30b188 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:51:54.033678 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 48904) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:54.035578 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.092361 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3525ffa8-f0bf-4b87-b3d2-6fe3ce62e28b None None] The sync data for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi is: [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:51:54.104700 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-069aeceb-b41b-4448-abc2-911a2560d9e4 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=69b81e28a9c24347aa9f3b0a04575374&name=default HTTP/1.1" status: 200 len: 2994 time: 1.8751886 Nov 21 13:51:54.113180 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-99c63ac4-42c4-4b9e-b3b3-616fab64e663 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 4.4960072 Nov 21 13:51:54.114591 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48906) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:54.133145 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-069aeceb-b41b-4448-abc2-911a2560d9e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e45a54fe-56e0-41d3-b934-719e1fcc950e,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:54.234146 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fd3904dc-a776-4e43-bf78-93e6872e29c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.236757 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fd3904dc-a776-4e43-bf78-93e6872e29c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.241388 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-fd3904dc-a776-4e43-bf78-93e6872e29c8 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/59101f72-6403-48de-94ce-d451db5cd9cb HTTP/1.1" status: 204 len: 168 time: 1.5002241 Nov 21 13:51:54.267063 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd3904dc-a776-4e43-bf78-93e6872e29c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59101f72-6403-48de-94ce-d451db5cd9cb,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:54.289915 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-24454b2f-570d-4bc5-be81-9fd7767d8af8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.318127 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-24454b2f-570d-4bc5-be81-9fd7767d8af8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.324334 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] For port 32a7269f-aa91-4f48-a140-c832f7cbd2f2, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:51:54.336905 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-16b816ef-e7b5-4fbb-a0ad-0c0e2296cebb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Request body: {'security_group_rule': {'security_group_id': '349be8ab-ade8-42df-afdf-99f127cdb471', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:54.363207 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:54.371358 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba9c3a5f-960b-4add-b7d1-fc0eebcecb6e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event updated for resources: {'SecurityGroup': ['ID=349be8ab-ade8-42df-afdf-99f127cdb471,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:54.382158 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] For port 32a7269f-aa91-4f48-a140-c832f7cbd2f2, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=32a7269f-aa91-4f48-a140-c832f7cbd2f2,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:51:54.386726 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-1a4ba0da-cac7-4f6e-9438-13c6f018a928 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.402940 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-24454b2f-570d-4bc5-be81-9fd7767d8af8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.405727 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-24454b2f-570d-4bc5-be81-9fd7767d8af8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.412906 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-24454b2f-570d-4bc5-be81-9fd7767d8af8 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/e45a54fe-56e0-41d3-b934-719e1fcc950e HTTP/1.1" status: 204 len: 168 time: 0.2954247 Nov 21 13:51:54.436252 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-1a4ba0da-cac7-4f6e-9438-13c6f018a928 None None] For port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=b90c7b7c-6c07-46d3-a05c-f48dfaf5adea,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:51:54.439682 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.442838 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=eda329ac-a209-4da8-b74f-a5e6cc6eb19c,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:54.446507 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24454b2f-570d-4bc5-be81-9fd7767d8af8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e45a54fe-56e0-41d3-b934-719e1fcc950e,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:54.516478 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ace0895d-3b3f-45db-92ba-602f9a379214 req-405f0edd-4cd3-4ffb-b1fb-985b82a5cce5 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6257870 Nov 21 13:51:54.518512 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75f80f48-90b9-459c-ba59-89ffdcbece1a None None] Pushing event updated for resources: {'Port': ['ID=32a7269f-aa91-4f48-a140-c832f7cbd2f2,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:54.531510 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-1a4ba0da-cac7-4f6e-9438-13c6f018a928 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.713732 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.747478 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Routers {'33e387fa-f34a-4ac8-9676-eb7f363972f4'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:51:54.748248 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:51:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['33e387fa-f34a-4ac8-9676-eb7f363972f4'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:54.874573 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-16b816ef-e7b5-4fbb-a0ad-0c0e2296cebb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:54.937940 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a4ba0da-cac7-4f6e-9438-13c6f018a928 None None] Pushing event updated for resources: {'Port': ['ID=b90c7b7c-6c07-46d3-a05c-f48dfaf5adea,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:54.961690 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-b30d8aa5-6854-4c1f-b43e-daa7f5fec4bf None None] Provisioning complete for port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:54.962066 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-b30d8aa5-6854-4c1f-b43e-daa7f5fec4bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:55.122428 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Router 0f049428-3827-4a0f-9254-57ee6dba40c0 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:51:55.253737 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] Set router 33e387fa-f34a-4ac8-9676-eb7f363972f4 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:51:55.358717 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-16b816ef-e7b5-4fbb-a0ad-0c0e2296cebb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:55.386900 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-16b816ef-e7b5-4fbb-a0ad-0c0e2296cebb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:55.642712 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:51:55.657136 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Sync routers for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:51:55.668652 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-11b65b9e-15c7-4cd0-9ad5-76eb4d920966 admin admin] 10.222.0.11 "PUT /v2.0/routers/0f049428-3827-4a0f-9254-57ee6dba40c0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.9451773 Nov 21 13:51:55.668652 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16b816ef-e7b5-4fbb-a0ad-0c0e2296cebb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0b8b1702-a540-4460-b5fd-cf850aee750a,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:55.685521 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-16b816ef-e7b5-4fbb-a0ad-0c0e2296cebb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:55.688638 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:51:55.689407 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48948) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:55.692366 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-16b816ef-e7b5-4fbb-a0ad-0c0e2296cebb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.3695002 Nov 21 13:51:55.699486 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-06a1098b-c1b9-4d02-a328-9cc00ac6a26e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Request body: {'security_group_rule': {'security_group_id': '349be8ab-ade8-42df-afdf-99f127cdb471', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:55.708073 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:51:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:55.741133 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Allocated IP 172.20.0.1 (63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a/a7f1c544-97e5-450d-9032-daf1d5a3a2a3/50c44d25-bd25-498f-8438-1dc33e1348ec) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:51:55.776951 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-8448f3f7-e0dc-4a93-a668-bdead72461d4 None None] Provisioning complete for port 352f29a9-b7fa-46f1-bcc4-584ce9176e66 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:55.777552 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8448f3f7-e0dc-4a93-a668-bdead72461d4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:55.809213 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-06a1098b-c1b9-4d02-a328-9cc00ac6a26e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:55.949080 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-8448f3f7-e0dc-4a93-a668-bdead72461d4 None None] Port 352f29a9-b7fa-46f1-bcc4-584ce9176e66 cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:51:56.008678 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'name': 'tempest-ServerRescueNegativeTestJSON-367439327-router', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:42Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 3, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'gw_port': {'id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:08:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:45Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:56.114755 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:51:56.122420 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48962) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:56.125609 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:56.138012 dv-cinder-768458-12-iscsi neutron-server[109041]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 21 13:51:56.147212 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-06a1098b-c1b9-4d02-a328-9cc00ac6a26e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:56.202757 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3cbb101-3396-456c-bcfa-495feb800a85 None None] The sync data for ids ['33e387fa-f34a-4ac8-9676-eb7f363972f4'] in dv-cinder-768458-12-iscsi is: [{'id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'name': 'tempest-ServerRescueNegativeTestJSON-367439327-router', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:42Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 3, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'gw_port': {'id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:08:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:45Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:51:56.275620 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:56.299641 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-06a1098b-c1b9-4d02-a328-9cc00ac6a26e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:56.444317 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a1098b-c1b9-4d02-a328-9cc00ac6a26e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d2628301-33c6-418e-a694-2ffd96102dad,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:56.445723 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:51:56.459938 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:56.483250 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:51:56.485875 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-470894'] for router_interface, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:56.514931 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device eda329ac-a209-4da8-b74f-a5e6cc6eb19c up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:51:56.535190 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-06a1098b-c1b9-4d02-a328-9cc00ac6a26e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:56.540197 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-06a1098b-c1b9-4d02-a328-9cc00ac6a26e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.8462234 Nov 21 13:51:56.541586 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48974) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:56.556817 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Request body: {'floatingip': {'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:56.608618 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Pushing event updated for resources: {'Port': ['ID=50c44d25-bd25-498f-8438-1dc33e1348ec,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:56.610878 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3505f42-8b77-4878-ae53-1da4c0fba3c2 req-46723fe1-2ad4-423d-a986-c240e66d6d88 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:56.612876 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c3505f42-8b77-4878-ae53-1da4c0fba3c2 req-46723fe1-2ad4-423d-a986-c240e66d6d88 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 931 time: 0.4893992 Nov 21 13:51:56.615270 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:56.688491 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port eda329ac-a209-4da8-b74f-a5e6cc6eb19c triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:56.688871 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:56.800312 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c3505f42-8b77-4878-ae53-1da4c0fba3c2 req-3195e582-89cd-4a27-b7a5-6d219b7fd286 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1731529 Nov 21 13:51:56.847077 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:56.861535 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-091dde77-2af3-48ad-8b03-3a9c1ded4ea0 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109041) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 13:51:56.864814 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-091dde77-2af3-48ad-8b03-3a9c1ded4ea0 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.50 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0071735 Nov 21 13:51:56.875281 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:51Z', 'revision_number': 2, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:57.045633 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device b90c7b7c-6c07-46d3-a05c-f48dfaf5adea up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:51:57.080319 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Checking router: 0f049428-3827-4a0f-9254-57ee6dba40c0 for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:51:57.080684 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Updating router 0f049428-3827-4a0f-9254-57ee6dba40c0 port 352f29a9-b7fa-46f1-bcc4-584ce9176e66 binding host dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:51:57.194456 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:57.215450 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:57.216002 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:57.227699 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:57.623405 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 48996) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:57.629814 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:57.651496 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:57.654196 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-cae71848-348a-4626-af3c-f2d5d9e0a210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1544131445', 'description': 'tempest-description--277106976'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:57.656442 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1684480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-473342'] for router_interface, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:57.767833 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Allocated IP 172.27.1.224 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/f63a919e-eec6-4f31-9b4c-30d7f633c35d) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:51:57.783096 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cae71848-348a-4626-af3c-f2d5d9e0a210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:57.839629 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Pushing event updated for resources: {'Port': ['ID=50c44d25-bd25-498f-8438-1dc33e1348ec,revision_number=2']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:58.027722 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49010) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:58.083773 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Publish callbacks [] for port, precommit_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:58.102062 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:58.145285 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:51:58.153043 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:58.185285 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cabd2df-c1cd-4ce5-86f0-69e6d02eb496 None None] Pushing event updated for resources: {'Port': ['ID=352f29a9-b7fa-46f1-bcc4-584ce9176e66,revision_number=3']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:58.332855 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Request body: {'port': {'device_id': 'f7ac629e-e375-4954-82d0-1efb9da7da3b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:51:58.350972 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Attempting to bind port 352f29a9-b7fa-46f1-bcc4-584ce9176e66 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:51:58.351738 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Attempting to bind port 352f29a9-b7fa-46f1-bcc4-584ce9176e66 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:51:58.352513 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Attempting to bind port 352f29a9-b7fa-46f1-bcc4-584ce9176e66 on network 24c864ef-5c5a-4df8-8968-78a7fe30b188 {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:51:58.366804 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 32a7269f-aa91-4f48-a140-c832f7cbd2f2 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:51:58.375451 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 51, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:51:58.376042 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Checking segment: {'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109043) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:51:58.377375 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:58.379255 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Bound using segment: {'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:51:58.383562 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Bound port: 352f29a9-b7fa-46f1-bcc4-584ce9176e66, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'}}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:51:58.383562 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:58.569010 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Router 33e387fa-f34a-4ac8-9676-eb7f363972f4 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:51:58.583275 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:58.605846 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 32a7269f-aa91-4f48-a140-c832f7cbd2f2 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:58.607662 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:58.611504 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] For port 352f29a9-b7fa-46f1-bcc4-584ce9176e66, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109043) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:51:58.619954 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] For port 352f29a9-b7fa-46f1-bcc4-584ce9176e66, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=352f29a9-b7fa-46f1-bcc4-584ce9176e66,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109043) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:51:58.630063 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:58.741457 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:51:58.745133 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:51:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:51:58.764293 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:58.787721 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1f9217ff-098c-448a-a31f-cb3e34e7f558 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:58.940868 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cae71848-348a-4626-af3c-f2d5d9e0a210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:58.983738 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:58.986743 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:59.028670 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-f86f8075-c199-484d-b9c9-e8b61df7b59f None None] Provisioning complete for port 352f29a9-b7fa-46f1-bcc4-584ce9176e66 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:51:59.029091 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-f86f8075-c199-484d-b9c9-e8b61df7b59f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:59.053538 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:51:59.076353 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:51:59.078899 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cae71848-348a-4626-af3c-f2d5d9e0a210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:59.093622 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-75e07df1-8bf2-485d-9cdf-f486878e0746 admin admin] 10.222.0.11 "PUT /v2.0/routers/33e387fa-f34a-4ac8-9676-eb7f363972f4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.0885093 Nov 21 13:51:59.162011 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:51:59.176470 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:51:59.218872 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port 32a7269f-aa91-4f48-a140-c832f7cbd2f2, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=32a7269f-aa91-4f48-a140-c832f7cbd2f2,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:51:59.258899 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cae71848-348a-4626-af3c-f2d5d9e0a210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=865776c3-79be-4d48-934d-4a1431a796df,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:59.263226 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1f9217ff-098c-448a-a31f-cb3e34e7f558 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:59.276299 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1f9217ff-098c-448a-a31f-cb3e34e7f558 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:59.303522 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ca4a1c9-b7ce-46cd-b1d2-8b9055916fdc req-f797493d-44aa-4dca-b95d-7c62ff3201dc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:51:59.317655 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7ca4a1c9-b7ce-46cd-b1d2-8b9055916fdc req-f797493d-44aa-4dca-b95d-7c62ff3201dc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 931 time: 1.2744272 Nov 21 13:51:59.382780 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:59.383648 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cabd2df-c1cd-4ce5-86f0-69e6d02eb496 None None] Pushing event updated for resources: {'Port': ['ID=352f29a9-b7fa-46f1-bcc4-584ce9176e66,revision_number=4']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:59.436747 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-1f9217ff-098c-448a-a31f-cb3e34e7f558 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=a49324e797ab4b03aa5d476a8a78e865&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4037941 Nov 21 13:51:59.436747 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f9217ff-098c-448a-a31f-cb3e34e7f558 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b6dc491-28ad-409a-ad27-4ea84908dab6,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:59.445286 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49038) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:51:59.535137 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:51:59.598961 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-f86f8075-c199-484d-b9c9-e8b61df7b59f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:59.605428 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fd72e881-5613-47fd-ac6c-9a4b11fb12c2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:59.630120 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event updated for resources: {'Port': ['ID=f63a919e-eec6-4f31-9b4c-30d7f633c35d,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:59.666724 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fd72e881-5613-47fd-ac6c-9a4b11fb12c2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:59.730625 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=32a7269f-aa91-4f48-a140-c832f7cbd2f2,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:59.778993 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fd72e881-5613-47fd-ac6c-9a4b11fb12c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:59.781844 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fd72e881-5613-47fd-ac6c-9a4b11fb12c2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:59.783116 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-fd72e881-5613-47fd-ac6c-9a4b11fb12c2 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/3b6dc491-28ad-409a-ad27-4ea84908dab6 HTTP/1.1" status: 204 len: 168 time: 0.3355229 Nov 21 13:51:59.784574 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-f86f8075-c199-484d-b9c9-e8b61df7b59f None None] For port 352f29a9-b7fa-46f1-bcc4-584ce9176e66, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=352f29a9-b7fa-46f1-bcc4-584ce9176e66,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:51:59.799004 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-f86f8075-c199-484d-b9c9-e8b61df7b59f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:51:59.813782 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd72e881-5613-47fd-ac6c-9a4b11fb12c2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b6dc491-28ad-409a-ad27-4ea84908dab6,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:51:59.878288 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Sync routers for ids ['33e387fa-f34a-4ac8-9676-eb7f363972f4'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:52:00.024602 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Routers {'33e387fa-f34a-4ac8-9676-eb7f363972f4'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:52:00.025917 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:51:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['33e387fa-f34a-4ac8-9676-eb7f363972f4'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:00.116802 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:58Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:00.173740 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-c7b15611-48d0-44d6-9d9f-651dd878f2ca None None] Provisioning complete for port 352f29a9-b7fa-46f1-bcc4-584ce9176e66 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:52:00.187630 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c7b15611-48d0-44d6-9d9f-651dd878f2ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:00.234236 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f86f8075-c199-484d-b9c9-e8b61df7b59f None None] Pushing event updated for resources: {'Port': ['ID=352f29a9-b7fa-46f1-bcc4-584ce9176e66,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:00.246138 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8824757c-2a4e-4595-bb7b-201ec9b81d3c None None] The sync data for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi is: [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:58Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:52:00.314371 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 32a7269f-aa91-4f48-a140-c832f7cbd2f2 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:52:00.329596 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4604a149-1016-4d3c-86d5-48111c9cc6eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:00.402867 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7ca4a1c9-b7ce-46cd-b1d2-8b9055916fdc req-c2e71afd-a705-4d6f-a391-d3b38d08ef0b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.0842085 Nov 21 13:52:00.418560 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cae71848-348a-4626-af3c-f2d5d9e0a210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:00.419995 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-cae71848-348a-4626-af3c-f2d5d9e0a210 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 2.7955523 Nov 21 13:52:00.423018 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49070) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:00.452257 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-4500348a-29b4-44ae-be6e-74a64b020fb0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Request body: {'security_group_rule': {'security_group_id': '865776c3-79be-4d48-934d-4a1431a796df', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:52:00.537421 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4500348a-29b4-44ae-be6e-74a64b020fb0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:00.743793 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4500348a-29b4-44ae-be6e-74a64b020fb0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:00.776141 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4500348a-29b4-44ae-be6e-74a64b020fb0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:00.924811 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Set router 33e387fa-f34a-4ac8-9676-eb7f363972f4 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:52:00.995739 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4500348a-29b4-44ae-be6e-74a64b020fb0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9f1f57c7-d92f-4dc8-b405-9336f24ed504,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:01.033583 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4500348a-29b4-44ae-be6e-74a64b020fb0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:01.044928 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-4500348a-29b4-44ae-be6e-74a64b020fb0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6198728 Nov 21 13:52:01.059661 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49090) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:01.073976 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-9536944f-6da8-471b-8bd3-40e5104665c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Request body: {'security_group_rule': {'security_group_id': '865776c3-79be-4d48-934d-4a1431a796df', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:52:01.199753 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 32a7269f-aa91-4f48-a140-c832f7cbd2f2 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:52:01.200157 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:01.215785 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:01.281794 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d5b4801-832c-4da1-a198-020c040d663c req-113dd97d-0245-41cd-b043-2bf262ed1674 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:01.285818 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-113dd97d-0245-41cd-b043-2bf262ed1674 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/networks?id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a HTTP/1.1" status: 200 len: 818 time: 0.5961742 Nov 21 13:52:01.387055 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8653e663-5da8-4b7e-91b0-8c94d45d51ad {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:52:01.410830 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-ca86d9f3-4855-4325-a9c3-47285e627ea5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/quotas/c90104f2696540809e93549d7ed3695f HTTP/1.1" status: 200 len: 375 time: 0.1087461 Nov 21 13:52:01.413993 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:01.430769 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9536944f-6da8-471b-8bd3-40e5104665c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:01.448348 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:01.486286 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49100) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:01.578753 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Transition to ACTIVE for port object 8653e663-5da8-4b7e-91b0-8c94d45d51ad will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:52:01.641908 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:01.753412 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Pushing event updated for resources: {'Port': ['ID=8653e663-5da8-4b7e-91b0-8c94d45d51ad,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:01.779743 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 49108) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:01.876046 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'name': 'tempest-ServerRescueNegativeTestJSON-367439327-router', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:42Z', 'updated_at': '2021-11-21T13:51:56Z', 'revision_number': 4, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'gw_port': {'id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:08:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:45Z', 'updated_at': '2021-11-21T13:51:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '50c44d25-bd25-498f-8438-1dc33e1348ec', 'name': '', 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'mac_address': 'fa:16:3e:7c:8f:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'a7f1c544-97e5-450d-9032-daf1d5a3a2a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:54Z', 'updated_at': '2021-11-21T13:51:57Z', 'revision_number': 2, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'subnets': [{'id': 'a7f1c544-97e5-450d-9032-daf1d5a3a2a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:01.878082 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-87a98fe3-e0ce-46cf-b1be-002929cbb426 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=c90104f2696540809e93549d7ed3695f&fields=id HTTP/1.1" status: 200 len: 255 time: 0.4475420 Nov 21 13:52:01.878584 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-469da605-cd27-4c5d-a61e-0c0be15848f2 req-dfbd1e1e-b75b-407c-8bf4-4be36cf8587e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:01.880200 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-469da605-cd27-4c5d-a61e-0c0be15848f2 req-dfbd1e1e-b75b-407c-8bf4-4be36cf8587e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 943 time: 0.3054817 Nov 21 13:52:01.927277 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Checking router: 33e387fa-f34a-4ac8-9676-eb7f363972f4 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:52:01.928554 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Updating router 33e387fa-f34a-4ac8-9676-eb7f363972f4 port 50c44d25-bd25-498f-8438-1dc33e1348ec binding host dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:52:01.965289 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.059132 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a3a861b8-9d7e-462f-996f-0dc3ae139d37 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.347787 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9536944f-6da8-471b-8bd3-40e5104665c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.395226 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Publish callbacks [] for port, precommit_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.398198 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a3a861b8-9d7e-462f-996f-0dc3ae139d37 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.405419 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 352f29a9-b7fa-46f1-bcc4-584ce9176e66 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:52:02.407376 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9536944f-6da8-471b-8bd3-40e5104665c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.476299 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2a491353-8c93-4f85-8280-6f879da62c31 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.482891 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.510994 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9536944f-6da8-471b-8bd3-40e5104665c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=604cdfba-3859-4005-815c-2d047d64676a,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:02.511287 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.523621 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.536123 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9536944f-6da8-471b-8bd3-40e5104665c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.544690 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-9536944f-6da8-471b-8bd3-40e5104665c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.4833312 Nov 21 13:52:02.549594 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49124) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:02.559314 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Request body: {'floatingip': {'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:52:02.566261 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40e03122-36f2-4ef8-9841-53f7bb9b329e None None] Pushing event updated for resources: {'Port': ['ID=50c44d25-bd25-498f-8438-1dc33e1348ec,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:02.608836 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-40a20caf-1cf4-4286-8616-25342bacf27d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.612627 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 352f29a9-b7fa-46f1-bcc4-584ce9176e66 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:52:02.612999 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.679879 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a3a861b8-9d7e-462f-996f-0dc3ae139d37 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.697495 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-068ae4d3-efb1-46cd-994b-bb90aad27856 service neutron] 10.222.0.11 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7988632 Nov 21 13:52:02.734794 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.912595 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Attempting to bind port 8653e663-5da8-4b7e-91b0-8c94d45d51ad on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:52:02.915338 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Attempting to bind port 8653e663-5da8-4b7e-91b0-8c94d45d51ad by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': 'af3504fe-7a5c-4c47-a5ed-ae3a2be59084', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 549, 'network_id': '329f6f8a-93b1-430a-8c57-dacb018278ff'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:52:02.920123 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Attempting to bind port 8653e663-5da8-4b7e-91b0-8c94d45d51ad on network 329f6f8a-93b1-430a-8c57-dacb018278ff {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:52:02.925800 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2a491353-8c93-4f85-8280-6f879da62c31 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.935030 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49138) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:02.936334 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-a3a861b8-9d7e-462f-996f-0dc3ae139d37 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=2d2f90d297e9491eb33f886bb722912d&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1412735 Nov 21 13:52:02.943978 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2a491353-8c93-4f85-8280-6f879da62c31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:02.960593 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-469da605-cd27-4c5d-a61e-0c0be15848f2 req-8c8227cf-c276-415d-a7c7-e33756be716f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.0531096 Nov 21 13:52:02.965819 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-5f4ade10-cc2f-4984-b608-d25fe6488e67 service neutron] 10.222.0.11 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2506742 Nov 21 13:52:02.983415 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Port 8653e663-5da8-4b7e-91b0-8c94d45d51ad on network 329f6f8a-93b1-430a-8c57-dacb018278ff not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:52:02.983579 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Attempting to bind port 8653e663-5da8-4b7e-91b0-8c94d45d51ad on network 329f6f8a-93b1-430a-8c57-dacb018278ff {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:52:02.999827 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 51, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:52:03.001054 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Checking segment: {'id': 'af3504fe-7a5c-4c47-a5ed-ae3a2be59084', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 549, 'network_id': '329f6f8a-93b1-430a-8c57-dacb018278ff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:52:03.001916 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Bound using segment: {'id': 'af3504fe-7a5c-4c47-a5ed-ae3a2be59084', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 549, 'network_id': '329f6f8a-93b1-430a-8c57-dacb018278ff'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:52:03.003437 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Bound port: 8653e663-5da8-4b7e-91b0-8c94d45d51ad, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'af3504fe-7a5c-4c47-a5ed-ae3a2be59084', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 549, 'network_id': '329f6f8a-93b1-430a-8c57-dacb018278ff'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:52:03.003941 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:03.007087 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event updated for resources: {'Port': ['ID=f63a919e-eec6-4f31-9b4c-30d7f633c35d,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:03.055095 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:03.069575 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3a861b8-9d7e-462f-996f-0dc3ae139d37 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=984814e0-d131-4d32-9640-f365ec48381b,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:03.106883 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Attempting to bind port 50c44d25-bd25-498f-8438-1dc33e1348ec on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:52:03.107443 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Attempting to bind port 50c44d25-bd25-498f-8438-1dc33e1348ec by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '87188554-865b-4f60-ac47-7f9dc768573f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:52:03.107621 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Attempting to bind port 50c44d25-bd25-498f-8438-1dc33e1348ec on network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:52:03.151127 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a491353-8c93-4f85-8280-6f879da62c31 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a80bc3d-61b2-4312-bf24-489c3cc17488,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:03.159214 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-2a491353-8c93-4f85-8280-6f879da62c31 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=6bde630370a448e8a0f2f48bb009a363&name=default HTTP/1.1" status: 200 len: 2996 time: 1.6717415 Nov 21 13:52:03.167523 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49148) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:03.178946 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] For port 8653e663-5da8-4b7e-91b0-8c94d45d51ad, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:52:03.181687 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 51, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:52:03.182079 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Checking segment: {'id': '87188554-865b-4f60-ac47-7f9dc768573f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:52:03.182496 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:03.182896 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Bound using segment: {'id': '87188554-865b-4f60-ac47-7f9dc768573f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:52:03.187369 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Bound port: 50c44d25-bd25-498f-8438-1dc33e1348ec, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '87188554-865b-4f60-ac47-7f9dc768573f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:52:03.187796 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:03.189769 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] For port 8653e663-5da8-4b7e-91b0-8c94d45d51ad, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8653e663-5da8-4b7e-91b0-8c94d45d51ad,segment=NetworkSegment(af3504fe-7a5c-4c47-a5ed-ae3a2be59084),segment_id=af3504fe-7a5c-4c47-a5ed-ae3a2be59084)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:52:03.201284 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:03.206173 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-61d0fe2e-523c-4a46-85bd-bca9e52d4607 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 6.6636269 Nov 21 13:52:03.210005 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:03.247145 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1e2a575d-2832-4107-8242-4e8b9ad4ab5d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:03.338381 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:03.344368 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:03.348340 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1e2a575d-2832-4107-8242-4e8b9ad4ab5d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:03.371401 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] 10.222.0.50 "PUT /v2.0/ports/8653e663-5da8-4b7e-91b0-8c94d45d51ad HTTP/1.1" status: 200 len: 1093 time: 5.9464567 Nov 21 13:52:03.391948 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f7ac629e-e375-4954-82d0-1efb9da7da3b', 'tag': '8653e663-5da8-4b7e-91b0-8c94d45d51ad'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:52:03.440389 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5a62aed8-b440-4baa-9fb3-035edd0e92d1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:03.472305 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:03.533554 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] For port 50c44d25-bd25-498f-8438-1dc33e1348ec, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:52:03.553631 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] For port 50c44d25-bd25-498f-8438-1dc33e1348ec, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=50c44d25-bd25-498f-8438-1dc33e1348ec,segment=NetworkSegment(87188554-865b-4f60-ac47-7f9dc768573f),segment_id=87188554-865b-4f60-ac47-7f9dc768573f)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:52:03.575482 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:03.738871 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0118ed8-4001-4209-913a-5f03217bada7 service neutron] Pushing event updated for resources: {'Port': ['ID=8653e663-5da8-4b7e-91b0-8c94d45d51ad,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:03.765823 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40e03122-36f2-4ef8-9841-53f7bb9b329e None None] Pushing event updated for resources: {'Port': ['ID=50c44d25-bd25-498f-8438-1dc33e1348ec,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:03.853328 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Routers {'33e387fa-f34a-4ac8-9676-eb7f363972f4'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:52:03.856792 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:52:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['33e387fa-f34a-4ac8-9676-eb7f363972f4'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:03.871061 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8c0c7b7f-abc3-432f-b059-532b9077d3cd req-cbbc9618-d102-4cc0-a32f-2e7ff07f0789 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 210 time: 0.3300252 Nov 21 13:52:03.889499 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5a62aed8-b440-4baa-9fb3-035edd0e92d1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:03.908062 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c93f8665-c570-4ca7-98cb-ff6157e455cf" -d '{"events": [{"name": "network-changed", "server_uuid": "f7ac629e-e375-4954-82d0-1efb9da7da3b", "tag": "8653e663-5da8-4b7e-91b0-8c94d45d51ad"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:52:03.994437 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-c1c6eea9-3b57-4d62-a583-b6089ba6fc00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:03.996700 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-c1c6eea9-3b57-4d62-a583-b6089ba6fc00 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=9580a66e32944e649fafe038a1d4cc4a&device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 1096 time: 0.4925754 Nov 21 13:52:04.006932 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1e2a575d-2832-4107-8242-4e8b9ad4ab5d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:04.012230 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1e2a575d-2832-4107-8242-4e8b9ad4ab5d admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:04.015724 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-1e2a575d-2832-4107-8242-4e8b9ad4ab5d admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/984814e0-d131-4d32-9640-f365ec48381b HTTP/1.1" status: 204 len: 168 time: 1.0769448 Nov 21 13:52:04.085741 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:04.113619 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-000d31f8-b3e5-46f0-aade-b8b5c992189d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-securitygroup--908046903&fields=id&tenant_id=389c281a19bb49e583633f57108f7f69 HTTP/1.1" status: 200 len: 267 time: 0.3841891 Nov 21 13:52:04.116851 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e2a575d-2832-4107-8242-4e8b9ad4ab5d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=984814e0-d131-4d32-9640-f365ec48381b,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:04.232965 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Allocated IP 172.27.1.222 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/08a8efe5-bdb0-4f2e-9dcb-b44c5671c48a) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:52:04.233716 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-9d00d741-0b46-42f3-ae2c-4b069291d2ef service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8653e663-5da8-4b7e-91b0-8c94d45d51ad HTTP/1.1" status: 200 len: 217 time: 0.2248025 Nov 21 13:52:04.237749 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5a62aed8-b440-4baa-9fb3-035edd0e92d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:04.242662 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5a62aed8-b440-4baa-9fb3-035edd0e92d1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:04.248938 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-5a62aed8-b440-4baa-9fb3-035edd0e92d1 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0a80bc3d-61b2-4312-bf24-489c3cc17488 HTTP/1.1" status: 204 len: 168 time: 1.0785766 Nov 21 13:52:04.307363 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] Set router 33e387fa-f34a-4ac8-9676-eb7f363972f4 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:52:04.401736 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-b4b81f6d-93db-46d4-a6cf-27d0754a6901 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:04.404590 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-b4b81f6d-93db-46d4-a6cf-27d0754a6901 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=b2250609-3053-4cfc-afb4-7edd4f2f599d HTTP/1.1" status: 200 len: 852 time: 0.1336918 Nov 21 13:52:04.452249 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:52:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-253b9699-7eaf-445c-a554-33e3fd3f3b1f x-openstack-request-id: req-253b9699-7eaf-445c-a554-33e3fd3f3b1f {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:52:04.452546 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f7ac629e-e375-4954-82d0-1efb9da7da3b", "tag": "8653e663-5da8-4b7e-91b0-8c94d45d51ad", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:52:04.452804 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-253b9699-7eaf-445c-a554-33e3fd3f3b1f {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:52:04.453325 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f7ac629e-e375-4954-82d0-1efb9da7da3b', 'tag': '8653e663-5da8-4b7e-91b0-8c94d45d51ad', 'status': 'completed', 'code': 200} Nov 21 13:52:04.457421 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a62aed8-b440-4baa-9fb3-035edd0e92d1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a80bc3d-61b2-4312-bf24-489c3cc17488,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:04.676610 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-ee24c41c-d8c8-4a0e-a786-df034ca836fd service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=329f6f8a-93b1-430a-8c57-dacb018278ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1866043 Nov 21 13:52:04.712177 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-6ae79ee7-244d-4408-aa38-f485fcf78a7e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:04.722142 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-6ae79ee7-244d-4408-aa38-f485fcf78a7e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/networks?id=ea19090b-8034-4904-8b6c-1752befe0b5a HTTP/1.1" status: 200 len: 811 time: 0.5812864 Nov 21 13:52:04.812193 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:04.862330 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-61ffc6f2-3aa0-403f-a00d-95109eda4009 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/quotas/389c281a19bb49e583633f57108f7f69 HTTP/1.1" status: 200 len: 375 time: 0.1378818 Nov 21 13:52:04.887124 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:04.932657 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 49228) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:04.974285 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event updated for resources: {'Port': ['ID=08a8efe5-bdb0-4f2e-9dcb-b44c5671c48a,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:04.986998 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a6bfeede-2ba2-41e1-b8b6-2e8abf1388f3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:05.027967 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-98b6289f-fcc1-4266-b7e6-6737a1b27927 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=389c281a19bb49e583633f57108f7f69&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1559649 Nov 21 13:52:05.038243 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:52:05.050500 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38af1e8e-c497-4a33-b9ee-41848bba3d14 req-d52003d1-f3d7-4c24-9014-07e46829c4fa tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:05.056184 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-38af1e8e-c497-4a33-b9ee-41848bba3d14 req-d52003d1-f3d7-4c24-9014-07e46829c4fa tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 943 time: 0.3759797 Nov 21 13:52:05.117678 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:05.178022 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'name': 'tempest-ServerRescueNegativeTestJSON-367439327-router', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:42Z', 'updated_at': '2021-11-21T13:51:56Z', 'revision_number': 4, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'gw_port': {'id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:08:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:45Z', 'updated_at': '2021-11-21T13:51:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '50c44d25-bd25-498f-8438-1dc33e1348ec', 'name': '', 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'mac_address': 'fa:16:3e:7c:8f:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'a7f1c544-97e5-450d-9032-daf1d5a3a2a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:54Z', 'updated_at': '2021-11-21T13:52:03Z', 'revision_number': 4, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'subnets': [{'id': 'a7f1c544-97e5-450d-9032-daf1d5a3a2a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:05.197388 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-bdb9ce85-f08f-45fd-90ba-c09f81b7d83e service neutron] 10.222.0.11 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1578498 Nov 21 13:52:05.218510 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:52:05.242388 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:52:05.262199 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d24a49d0-9d27-4ab3-8f90-fc25e9a5604b None None] The sync data for ids ['33e387fa-f34a-4ac8-9676-eb7f363972f4'] in dv-cinder-768458-12-iscsi is: [{'id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'name': 'tempest-ServerRescueNegativeTestJSON-367439327-router', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:42Z', 'updated_at': '2021-11-21T13:51:56Z', 'revision_number': 4, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'gw_port': {'id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:08:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:45Z', 'updated_at': '2021-11-21T13:51:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '50c44d25-bd25-498f-8438-1dc33e1348ec', 'name': '', 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'mac_address': 'fa:16:3e:7c:8f:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'a7f1c544-97e5-450d-9032-daf1d5a3a2a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:54Z', 'updated_at': '2021-11-21T13:52:03Z', 'revision_number': 4, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'subnets': [{'id': 'a7f1c544-97e5-450d-9032-daf1d5a3a2a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:52:05.496017 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a6bfeede-2ba2-41e1-b8b6-2e8abf1388f3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:05.509963 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a6bfeede-2ba2-41e1-b8b6-2e8abf1388f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:05.593993 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6bfeede-2ba2-41e1-b8b6-2e8abf1388f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bfbe0218-3379-4d08-bf04-369dfb720742,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:05.615121 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-043a98a1-919c-4ddd-9e5d-8ceedabea3f5 service neutron] 10.222.0.50 "GET /v2.0/networks/329f6f8a-93b1-430a-8c57-dacb018278ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8480060 Nov 21 13:52:05.619396 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:05.667424 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 49256) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:05.715414 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:05.847771 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:05.866630 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-12b6868a-ec86-42ae-905b-7a856b8bcf74 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:05.907944 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-a6bfeede-2ba2-41e1-b8b6-2e8abf1388f3 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=f3386dd9d29b4fafbb25623f69e49bae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9728692 Nov 21 13:52:05.920974 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-38af1e8e-c497-4a33-b9ee-41848bba3d14 req-b85ebcb2-c64a-49de-9176-c2282ff22ccc tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6437991 Nov 21 13:52:05.943197 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49264) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:05.991100 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-8e6ffc5b-b664-489f-a539-a6f528855276 service neutron] 10.222.0.11 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7927370 Nov 21 13:52:06.096371 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40238efb-9ae1-4aee-9874-fc3fcf951cc5 req-5714a3e3-b161-494d-9bf6-68b474b9b736 service neutron] 10.222.0.50 "GET /v2.0/networks/329f6f8a-93b1-430a-8c57-dacb018278ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4595721 Nov 21 13:52:06.192572 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9c332eb-135b-4fe8-8c9c-63a288f61b79 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.282592 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9c332eb-135b-4fe8-8c9c-63a288f61b79 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.348306 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.351638 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 50c44d25-bd25-498f-8438-1dc33e1348ec up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:52:06.359361 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.408457 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-12b6868a-ec86-42ae-905b-7a856b8bcf74 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.434129 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-12b6868a-ec86-42ae-905b-7a856b8bcf74 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.454401 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.463654 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-05613888-9dfe-4844-8c92-11e7102de97a req-81fbe530-baac-4b9c-9db4-e335e8fe65cb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 210 time: 0.0570259 Nov 21 13:52:06.502112 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9c332eb-135b-4fe8-8c9c-63a288f61b79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.507531 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9c332eb-135b-4fe8-8c9c-63a288f61b79 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.508915 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-c9c332eb-135b-4fe8-8c9c-63a288f61b79 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/bfbe0218-3379-4d08-bf04-369dfb720742 HTTP/1.1" status: 204 len: 168 time: 0.5646331 Nov 21 13:52:06.524187 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.525747 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.9718328 Nov 21 13:52:06.531049 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-098b51bf-9ca7-4471-8ef1-16f3713e546c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event updated for resources: {'Port': ['ID=08a8efe5-bdb0-4f2e-9dcb-b44c5671c48a,revision_number=2']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:06.534018 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9c332eb-135b-4fe8-8c9c-63a288f61b79 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bfbe0218-3379-4d08-bf04-369dfb720742,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:06.534284 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 50c44d25-bd25-498f-8438-1dc33e1348ec triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:52:06.534836 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.541631 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-12b6868a-ec86-42ae-905b-7a856b8bcf74 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=0a638cc1fbcd474282b096aa38020cc2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8586628 Nov 21 13:52:06.544315 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49288) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:06.584310 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b6868a-ec86-42ae-905b-7a856b8bcf74 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=70ce04c9-0a58-4e5b-aebe-21e68fc57441,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:06.600049 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-eba2f3e1-b52f-4495-8e8b-1a5371363475 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:06.611309 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-eba2f3e1-b52f-4495-8e8b-1a5371363475 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/networks?id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a HTTP/1.1" status: 200 len: 818 time: 0.4726887 Nov 21 13:52:06.663470 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-50ea3e18-9530-413b-89a6-e54697b04190 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.747375 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-50ea3e18-9530-413b-89a6-e54697b04190 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.897841 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:06.941946 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port 50c44d25-bd25-498f-8438-1dc33e1348ec, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=50c44d25-bd25-498f-8438-1dc33e1348ec,segment=NetworkSegment(87188554-865b-4f60-ac47-7f9dc768573f),segment_id=87188554-865b-4f60-ac47-7f9dc768573f)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:06.953592 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:07.026564 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-2bc94d8d-6ea7-48e8-9f89-da3aa0444157 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/quotas/c90104f2696540809e93549d7ed3695f HTTP/1.1" status: 200 len: 375 time: 0.3918321 Nov 21 13:52:07.066074 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-26fbbdd9-a0ba-4240-bbb8-c3ffa80a1afb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:07.068820 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-26fbbdd9-a0ba-4240-bbb8-c3ffa80a1afb service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=9580a66e32944e649fafe038a1d4cc4a&device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 1096 time: 0.4550600 Nov 21 13:52:07.085602 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=50c44d25-bd25-498f-8438-1dc33e1348ec,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:07.171235 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-9fcda1d9-8899-44f7-b80c-db049954ff5a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-securitygroup--1544131445&fields=id&tenant_id=3d25ecbdc2ba435488271022d897a406 HTTP/1.1" status: 200 len: 267 time: 0.0482101 Nov 21 13:52:07.187481 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-50ea3e18-9530-413b-89a6-e54697b04190 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:07.192816 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-50ea3e18-9530-413b-89a6-e54697b04190 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:07.194510 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-50ea3e18-9530-413b-89a6-e54697b04190 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/70ce04c9-0a58-4e5b-aebe-21e68fc57441 HTTP/1.1" status: 204 len: 168 time: 0.6484857 Nov 21 13:52:07.222991 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50ea3e18-9530-413b-89a6-e54697b04190 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70ce04c9-0a58-4e5b-aebe-21e68fc57441,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:07.427951 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.50', 61795) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:07.435744 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-09604d2a-d02e-4c7d-bcbd-e321dbf2ee20 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:07.442642 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-09604d2a-d02e-4c7d-bcbd-e321dbf2ee20 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/networks?id=24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 200 len: 817 time: 0.2570403 Nov 21 13:52:07.468476 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-980336d1-dae6-48a1-9f4f-8d5219db6cea tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/quotas/3d25ecbdc2ba435488271022d897a406 HTTP/1.1" status: 200 len: 375 time: 0.0109105 Nov 21 13:52:07.589043 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-164ae235-ad2a-4ea8-9fda-a3909818fbeb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1196222 Nov 21 13:52:07.805588 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d5b4801-832c-4da1-a198-020c040d663c req-c6dfd40f-191d-4a3e-b3f9-aea22587d5a5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:07.809104 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-c6dfd40f-191d-4a3e-b3f9-aea22587d5a5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.50 "GET /v2.0/networks?id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a HTTP/1.1" status: 200 len: 818 time: 0.3570697 Nov 21 13:52:07.862826 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-6d5b4801-832c-4da1-a198-020c040d663c req-af81cb19-e5b8-4806-8f7c-540b5d6039d7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Request body: {'port': {'device_id': '2d1c9d3d-f088-4d2f-b2bc-e26543509aae', 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a', 'admin_state_up': True, 'tenant_id': 'c90104f2696540809e93549d7ed3695f'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:52:07.866758 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-ff180d16-f52b-404f-abb3-e5e325540f7a service neutron] 10.222.0.11 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2539022 Nov 21 13:52:07.884871 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-1ce3ddef-2633-4605-85cb-34ae141dafb3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=c90104f2696540809e93549d7ed3695f&fields=id HTTP/1.1" status: 200 len: 255 time: 0.8486583 Nov 21 13:52:07.992987 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-429d8f98-20a1-406b-a8c9-f3ea8186ad47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:07.995146 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-429d8f98-20a1-406b-a8c9-f3ea8186ad47 service neutron] 10.222.0.50 "GET /v2.0/networks?id=329f6f8a-93b1-430a-8c57-dacb018278ff HTTP/1.1" status: 200 len: 913 time: 0.8833306 Nov 21 13:52:08.078030 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-25c0a349-b272-4cf9-8f8d-7c201badddfc service neutron] 10.222.0.11 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2035096 Nov 21 13:52:08.139752 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-8b17c070-cda0-4021-8df4-310454bd3dd7 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8653e663-5da8-4b7e-91b0-8c94d45d51ad HTTP/1.1" status: 200 len: 217 time: 0.1357546 Nov 21 13:52:08.198732 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 50c44d25-bd25-498f-8438-1dc33e1348ec up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:52:08.234037 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.50', 61799) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:08.292196 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-a79cff15-746d-4d75-bba3-9cd61fba9a1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:08.293748 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-a79cff15-746d-4d75-bba3-9cd61fba9a1a service neutron] 10.222.0.50 "GET /v2.0/subnets?id=b2250609-3053-4cfc-afb4-7edd4f2f599d HTTP/1.1" status: 200 len: 852 time: 0.1363745 Nov 21 13:52:08.360212 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6d5b4801-832c-4da1-a198-020c040d663c req-af81cb19-e5b8-4806-8f7c-540b5d6039d7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Made reservation on behalf of c90104f2696540809e93549d7ed3695f for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:52:08.372794 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-6d5b4801-832c-4da1-a198-020c040d663c req-af81cb19-e5b8-4806-8f7c-540b5d6039d7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:08.411183 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-074404aa-699a-480a-be70-057874df1914 service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109041) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 13:52:08.412516 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-074404aa-699a-480a-be70-057874df1914 service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2143328 Nov 21 13:52:08.422478 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-81c2c906-9c36-4800-92eb-0edb4f3c1201 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=329f6f8a-93b1-430a-8c57-dacb018278ff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1101213 Nov 21 13:52:08.422941 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 50c44d25-bd25-498f-8438-1dc33e1348ec triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:52:08.424271 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:08.553539 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-1af4bd03-e8bb-45b8-9b78-388e7b36de3b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:08.564137 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-1af4bd03-e8bb-45b8-9b78-388e7b36de3b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.50 "GET /v2.0/networks?id=ea19090b-8034-4904-8b6c-1752befe0b5a HTTP/1.1" status: 200 len: 811 time: 0.3271112 Nov 21 13:52:08.807431 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-f9a74011-a5b1-420d-8612-6e6c8b1a79cb service neutron] 10.222.0.50 "GET /v2.0/networks/329f6f8a-93b1-430a-8c57-dacb018278ff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3747399 Nov 21 13:52:08.837677 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec0fc4e-a6da-462a-922e-bbe30be57dbb req-fd675f9f-b6fd-4cc6-abce-ef3c679ce7ce tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:08.845259 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1ec0fc4e-a6da-462a-922e-bbe30be57dbb req-fd675f9f-b6fd-4cc6-abce-ef3c679ce7ce tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 943 time: 0.2798824 Nov 21 13:52:08.875221 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-ff125b0b-4f2e-4d41-9f3a-0b94da7007bf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.50 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=389c281a19bb49e583633f57108f7f69 HTTP/1.1" status: 200 len: 379 time: 0.2277060 Nov 21 13:52:08.886861 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-f9aea1a0-58e9-49f8-8a75-b042a71d8dd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Request body: {'port': {'device_id': '1aa7ec26-0d3e-4d40-87d2-45e63ed435eb', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'admin_state_up': True, 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'security_groups': ['349be8ab-ade8-42df-afdf-99f127cdb471']}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:52:08.892270 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-1143dedd-f9c1-4941-aafd-8e67253e0030 service neutron] 10.222.0.11 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4632683 Nov 21 13:52:08.965991 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1ec0fc4e-a6da-462a-922e-bbe30be57dbb req-bacd5511-f2b7-49df-91ea-520d7b8bf375 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1194410 Nov 21 13:52:09.028182 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-6d5b4801-832c-4da1-a198-020c040d663c req-af81cb19-e5b8-4806-8f7c-540b5d6039d7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Allocated IP 172.20.0.3 (63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a/a7f1c544-97e5-450d-9032-daf1d5a3a2a3/e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:52:09.192666 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-525c3ab3-07a1-474e-a085-0c0cc92f4803 req-b26d3b05-7519-4044-ace7-51cfb2251e91 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 210 time: 0.0848074 Nov 21 13:52:09.221338 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-9abbd141-fccb-48e8-8c9f-cbb068574ac3 service neutron] 10.222.0.11 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2799397 Nov 21 13:52:09.232186 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c93f8665-c570-4ca7-98cb-ff6157e455cf req-511d9bc4-b9d5-4734-8717-1730449161a6 service neutron] 10.222.0.50 "GET /v2.0/networks/329f6f8a-93b1-430a-8c57-dacb018278ff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4054127 Nov 21 13:52:09.260160 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-f9aea1a0-58e9-49f8-8a75-b042a71d8dd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Made reservation on behalf of 389c281a19bb49e583633f57108f7f69 for: {'port': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:52:09.270824 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-f9aea1a0-58e9-49f8-8a75-b042a71d8dd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:09.435768 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-6d5b4801-832c-4da1-a198-020c040d663c req-af81cb19-e5b8-4806-8f7c-540b5d6039d7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:09.508360 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-6d5b4801-832c-4da1-a198-020c040d663c req-af81cb19-e5b8-4806-8f7c-540b5d6039d7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:09.520525 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-582f2a7a-9db9-4bb7-a224-ef60f9ffb55b req-fb208624-48fb-4bd2-a0df-1ef236b4c4d7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 210 time: 0.0771124 Nov 21 13:52:09.671424 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af81cb19-e5b8-4806-8f7c-540b5d6039d7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Pushing event updated for resources: {'Port': ['ID=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:09.681532 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 8653e663-5da8-4b7e-91b0-8c94d45d51ad details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:52:09.685519 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6d5b4801-832c-4da1-a198-020c040d663c req-af81cb19-e5b8-4806-8f7c-540b5d6039d7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:52:09.686958 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-6d5b4801-832c-4da1-a198-020c040d663c req-af81cb19-e5b8-4806-8f7c-540b5d6039d7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:52:09.694581 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-6d5b4801-832c-4da1-a198-020c040d663c req-af81cb19-e5b8-4806-8f7c-540b5d6039d7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:52:09.780904 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4f12972c-c5b5-4712-85da-4fbe0e3c1d07 req-d6f47dbc-1eac-4caa-9936-2d59f46771b1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 210 time: 0.0644972 Nov 21 13:52:09.797597 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d5b4801-832c-4da1-a198-020c040d663c req-af81cb19-e5b8-4806-8f7c-540b5d6039d7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:09.798318 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-6d5b4801-832c-4da1-a198-020c040d663c req-af81cb19-e5b8-4806-8f7c-540b5d6039d7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:09.822417 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-af81cb19-e5b8-4806-8f7c-540b5d6039d7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.9928379 Nov 21 13:52:09.838322 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Request body: {'port': {'device_id': '2d1c9d3d-f088-4d2f-b2bc-e26543509aae', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:52:09.896264 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-f9aea1a0-58e9-49f8-8a75-b042a71d8dd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Allocated IP 172.20.0.9 (ea19090b-8034-4904-8b6c-1752befe0b5a/8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0/e97fd0d3-216a-4615-aa4a-a98857cba123) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:52:09.943191 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 8653e663-5da8-4b7e-91b0-8c94d45d51ad, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8653e663-5da8-4b7e-91b0-8c94d45d51ad,segment=NetworkSegment(af3504fe-7a5c-4c47-a5ed-ae3a2be59084),segment_id=af3504fe-7a5c-4c47-a5ed-ae3a2be59084)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:09.944235 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:09.967981 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '8653e663-5da8-4b7e-91b0-8c94d45d51ad', 'network_id': '329f6f8a-93b1-430a-8c57-dacb018278ff', 'port_id': '8653e663-5da8-4b7e-91b0-8c94d45d51ad', 'mac_address': 'fa:16:3e:f9:21:f4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 549, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b2250609-3053-4cfc-afb4-7edd4f2f599d', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:52:10.024248 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:10.062361 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8653e663-5da8-4b7e-91b0-8c94d45d51ad {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:52:10.092939 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 8653e663-5da8-4b7e-91b0-8c94d45d51ad, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8653e663-5da8-4b7e-91b0-8c94d45d51ad,segment=NetworkSegment(af3504fe-7a5c-4c47-a5ed-ae3a2be59084),segment_id=af3504fe-7a5c-4c47-a5ed-ae3a2be59084)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:10.099425 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:10.170608 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=8653e663-5da8-4b7e-91b0-8c94d45d51ad,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:10.273935 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-f9aea1a0-58e9-49f8-8a75-b042a71d8dd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:10.275632 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49474) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:10.333203 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-f9aea1a0-58e9-49f8-8a75-b042a71d8dd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:10.399131 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['8653e663-5da8-4b7e-91b0-8c94d45d51ad'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:52:10.495640 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-f9aea1a0-58e9-49f8-8a75-b042a71d8dd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Network ea19090b-8034-4904-8b6c-1752befe0b5a is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:52:10.514443 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-f9aea1a0-58e9-49f8-8a75-b042a71d8dd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:52:10.518495 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9aea1a0-58e9-49f8-8a75-b042a71d8dd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event updated for resources: {'Port': ['ID=e97fd0d3-216a-4615-aa4a-a98857cba123,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:10.520454 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-f9aea1a0-58e9-49f8-8a75-b042a71d8dd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:52:10.526409 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-f9aea1a0-58e9-49f8-8a75-b042a71d8dd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:10.527049 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-f9aea1a0-58e9-49f8-8a75-b042a71d8dd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for port, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:10.545118 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fc034b4-28e7-4cdb-b5d6-5b564ac5684b req-6170668b-2e5e-4029-ac51-c970b00b2339 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:10.548896 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa27745c-0a54-4925-9cd8-303bbe195424 req-2a722a2e-8bda-4aff-93e5-74fec269a45d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:10.549793 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-aa27745c-0a54-4925-9cd8-303bbe195424 req-2a722a2e-8bda-4aff-93e5-74fec269a45d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 931 time: 0.1425748 Nov 21 13:52:10.553873 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8fc034b4-28e7-4cdb-b5d6-5b564ac5684b req-6170668b-2e5e-4029-ac51-c970b00b2339 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 944 time: 0.3247790 Nov 21 13:52:10.554276 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-f9aea1a0-58e9-49f8-8a75-b042a71d8dd8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6722481 Nov 21 13:52:10.595035 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Request body: {'port': {'device_id': '1aa7ec26-0d3e-4d40-87d2-45e63ed435eb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:52:10.789439 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-aa27745c-0a54-4925-9cd8-303bbe195424 req-1c2e8b0c-b409-49af-ae64-5cfde8ac2d78 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2329276 Nov 21 13:52:10.802331 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:10.966854 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-aa3fcbab-3b40-4d12-93a2-de252bc43714 req-cc7b16a9-5a1d-4f6b-a319-941e20b9d9c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 210 time: 0.0545909 Nov 21 13:52:10.967763 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ccbaea73-633b-4083-baee-759413abd8fb admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:11.045406 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-f6621b7d-fef9-4e4c-88bd-cfbc4054eadd None None] Provisioning complete for port e97fd0d3-216a-4615-aa4a-a98857cba123 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:52:11.047396 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-f6621b7d-fef9-4e4c-88bd-cfbc4054eadd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:11.078001 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8fc034b4-28e7-4cdb-b5d6-5b564ac5684b req-6f178ec1-06bb-44c0-a6d8-7a4361ea56bb tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5188711 Nov 21 13:52:11.116194 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-f90d433a-c9a9-45a8-b957-831febf9b966 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:11.116566 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-f6621b7d-fef9-4e4c-88bd-cfbc4054eadd None None] Port e97fd0d3-216a-4615-aa4a-a98857cba123 cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:52:11.118264 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-f90d433a-c9a9-45a8-b957-831febf9b966 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.50 "GET /v2.0/networks?id=24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 200 len: 817 time: 0.8881438 Nov 21 13:52:11.225604 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-3b8d080a-bde7-4065-8f0e-c2581ebec347 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.50 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3d25ecbdc2ba435488271022d897a406 HTTP/1.1" status: 200 len: 380 time: 0.0955968 Nov 21 13:52:11.239114 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-2d753b42-bb69-4a20-8d15-9124961effca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Request body: {'port': {'device_id': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'admin_state_up': True, 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'security_groups': ['865776c3-79be-4d48-934d-4a1431a796df']}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:52:11.254334 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4b0c50ee-8f2f-4e82-a509-925baf7d1882 req-88e47c4b-2e0a-47c2-8b51-3190e27dd7da tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 210 time: 0.0743182 Nov 21 13:52:11.394840 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.50', 61809) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:11.510759 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:52:11.532645 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:11.544009 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ccbaea73-633b-4083-baee-759413abd8fb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:11.552683 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ccbaea73-633b-4083-baee-759413abd8fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:11.602174 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Transition to ACTIVE for port object e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:52:11.629561 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccbaea73-633b-4083-baee-759413abd8fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=72dce630-9d2e-4d23-9c63-5220290af35e,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:11.637040 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-ccbaea73-633b-4083-baee-759413abd8fb admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=f71c1442d69f4a038fbcb8b126f09b1d&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3600831 Nov 21 13:52:11.642295 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49524) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:11.643964 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:11.646248 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.notifiers.nova [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e97fd0d3-216a-4615-aa4a-a98857cba123 {{(pid=109040) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:52:11.662016 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:11.667852 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 8653e663-5da8-4b7e-91b0-8c94d45d51ad up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:52:11.680140 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-2d753b42-bb69-4a20-8d15-9124961effca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Made reservation on behalf of 3d25ecbdc2ba435488271022d897a406 for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:52:11.685076 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-2d753b42-bb69-4a20-8d15-9124961effca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:11.722050 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.provisioning_blocks [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Transition to ACTIVE for port object e97fd0d3-216a-4615-aa4a-a98857cba123 will not be triggered until provisioned by entity L2. {{(pid=109040) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:52:11.729387 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-cf9e6b0c-8863-4c14-b356-3316ff3205ab tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:11.730506 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:11.731376 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-cf9e6b0c-8863-4c14-b356-3316ff3205ab tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.50 "GET /v2.0/networks?id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a HTTP/1.1" status: 200 len: 818 time: 0.3357651 Nov 21 13:52:11.750893 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-529124c9-ddbb-4080-ba71-52c80a7e988e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Request body: {'port': {'device_id': 'e6f04799-b287-41b6-9756-b259d5eeddeb', 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a', 'admin_state_up': True, 'tenant_id': 'c90104f2696540809e93549d7ed3695f'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:52:11.792586 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8e480404-cf1e-4efd-93e7-501a0df44d0e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:11.818459 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port 8653e663-5da8-4b7e-91b0-8c94d45d51ad completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:52:11.849597 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Pushing event updated for resources: {'Port': ['ID=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:11.873297 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 8653e663-5da8-4b7e-91b0-8c94d45d51ad triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:52:11.877916 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:11.913940 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8e480404-cf1e-4efd-93e7-501a0df44d0e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:11.952722 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Pushing event updated for resources: {'Port': ['ID=e97fd0d3-216a-4615-aa4a-a98857cba123,revision_number=2']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:12.105749 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:12.152097 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8e480404-cf1e-4efd-93e7-501a0df44d0e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:12.155006 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8e480404-cf1e-4efd-93e7-501a0df44d0e admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:12.156370 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-8e480404-cf1e-4efd-93e7-501a0df44d0e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/72dce630-9d2e-4d23-9c63-5220290af35e HTTP/1.1" status: 204 len: 168 time: 0.5132744 Nov 21 13:52:12.157526 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f7ac629e-e375-4954-82d0-1efb9da7da3b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8653e663-5da8-4b7e-91b0-8c94d45d51ad'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:52:12.163181 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-172fb124-44c4-41f2-a742-cf315cc64c41 req-991b66a1-f5a6-4af0-818d-c3112d8bca31 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 210 time: 0.0682373 Nov 21 13:52:12.165418 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.managers [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Attempting to bind port e97fd0d3-216a-4615-aa4a-a98857cba123 on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109040) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:52:12.165851 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.managers [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Attempting to bind port e97fd0d3-216a-4615-aa4a-a98857cba123 by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'}] {{(pid=109040) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:52:12.166409 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Attempting to bind port e97fd0d3-216a-4615-aa4a-a98857cba123 on network ea19090b-8034-4904-8b6c-1752befe0b5a {{(pid=109040) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:52:12.179168 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e480404-cf1e-4efd-93e7-501a0df44d0e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72dce630-9d2e-4d23-9c63-5220290af35e,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:12.181431 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Port e97fd0d3-216a-4615-aa4a-a98857cba123 on network ea19090b-8034-4904-8b6c-1752befe0b5a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109040) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:52:12.181750 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Attempting to bind port e97fd0d3-216a-4615-aa4a-a98857cba123 on network ea19090b-8034-4904-8b6c-1752befe0b5a {{(pid=109040) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:52:12.200822 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 51, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109040) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:52:12.201270 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Checking segment: {'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109040) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:52:12.202213 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Bound using segment: {'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'} {{(pid=109040) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:52:12.202771 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.managers [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Bound port: e97fd0d3-216a-4615-aa4a-a98857cba123, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'}}] {{(pid=109040) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:52:12.203385 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:12.303970 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] For port e97fd0d3-216a-4615-aa4a-a98857cba123, host hv-cinder-76845, cleared binding levels {{(pid=109040) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:52:12.309096 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] For port e97fd0d3-216a-4615-aa4a-a98857cba123, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=e97fd0d3-216a-4615-aa4a-a98857cba123,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109040) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:52:12.320289 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:12.354717 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 8653e663-5da8-4b7e-91b0-8c94d45d51ad, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8653e663-5da8-4b7e-91b0-8c94d45d51ad,segment=NetworkSegment(af3504fe-7a5c-4c47-a5ed-ae3a2be59084),segment_id=af3504fe-7a5c-4c47-a5ed-ae3a2be59084)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:12.377468 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-2d753b42-bb69-4a20-8d15-9124961effca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Allocated IP 172.20.0.13 (24c864ef-5c5a-4df8-8968-78a7fe30b188/c4887ea6-9c0e-4a7b-bd51-d70b335ceb92/627d561d-d2ff-449e-a99f-9e5e3fd874ba) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:52:12.379924 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:12.477537 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:12.480000 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for port, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:12.481533 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] 10.222.0.50 "PUT /v2.0/ports/e97fd0d3-216a-4615-aa4a-a98857cba123 HTTP/1.1" status: 200 len: 1093 time: 1.8985326 Nov 21 13:52:12.482304 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1aa7ec26-0d3e-4d40-87d2-45e63ed435eb', 'tag': 'e97fd0d3-216a-4615-aa4a-a98857cba123'}] {{(pid=109040) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:52:12.492733 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=8653e663-5da8-4b7e-91b0-8c94d45d51ad,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:12.529934 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Attempting to bind port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:52:12.530303 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Attempting to bind port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '87188554-865b-4f60-ac47-7f9dc768573f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:52:12.530637 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Attempting to bind port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 on network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:52:12.545512 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9aedcaf8-5197-4542-b6fa-16b870d687da" -d '{"events": [{"server_uuid": "f7ac629e-e375-4954-82d0-1efb9da7da3b", "name": "network-vif-plugged", "status": "completed", "tag": "8653e663-5da8-4b7e-91b0-8c94d45d51ad"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:52:12.589156 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 on network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:52:12.589490 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Attempting to bind port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 on network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:52:12.592012 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-529124c9-ddbb-4080-ba71-52c80a7e988e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Made reservation on behalf of c90104f2696540809e93549d7ed3695f for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:52:12.595671 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-529124c9-ddbb-4080-ba71-52c80a7e988e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:12.610775 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a61046a-df36-4f9f-8e6b-58f2b83dfeaf req-5536593a-0ddb-47f8-bfb9-2c526b50dc05 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:12.612312 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7a61046a-df36-4f9f-8e6b-58f2b83dfeaf req-5536593a-0ddb-47f8-bfb9-2c526b50dc05 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 943 time: 0.6542561 Nov 21 13:52:12.634684 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 51, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:52:12.635027 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Checking segment: {'id': '87188554-865b-4f60-ac47-7f9dc768573f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:52:12.635416 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Bound using segment: {'id': '87188554-865b-4f60-ac47-7f9dc768573f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:52:12.635976 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Bound port: e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '87188554-865b-4f60-ac47-7f9dc768573f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:52:12.636237 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:12.690512 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-defc4d0c-7a05-45ea-93aa-a95b658d9319 service neutron] Pushing event updated for resources: {'Port': ['ID=e97fd0d3-216a-4615-aa4a-a98857cba123,revision_number=3']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:12.704582 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2953ea71-f6b2-4cf4-889f-65011ceac037 req-920698b9-2161-4b3a-b240-9ea9aca49206 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:12.706278 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2953ea71-f6b2-4cf4-889f-65011ceac037 req-920698b9-2161-4b3a-b240-9ea9aca49206 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 944 time: 0.3894947 Nov 21 13:52:12.754983 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-2d753b42-bb69-4a20-8d15-9124961effca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:12.757366 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-298437c2-6424-4bce-af3e-f8c014370cbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:12.759519 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-298437c2-6424-4bce-af3e-f8c014370cbe service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=389c281a19bb49e583633f57108f7f69&device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 1096 time: 0.1722527 Nov 21 13:52:12.835848 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7a61046a-df36-4f9f-8e6b-58f2b83dfeaf req-99494b10-f4e3-483d-8154-3ec914195b78 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2108650 Nov 21 13:52:12.846554 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-fad975a4-50ca-4823-8945-43b5d5c84342 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e97fd0d3-216a-4615-aa4a-a98857cba123 HTTP/1.1" status: 200 len: 217 time: 0.0724087 Nov 21 13:52:12.868413 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2953ea71-f6b2-4cf4-889f-65011ceac037 req-f1963d91-23c7-4e5c-8cd2-732f05f3cc7e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1525085 Nov 21 13:52:12.895487 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a0fb9e652e748194bc1d59d499050652e1260aa6f54aa3e041aed7364c74523c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a448820a-51e8-4154-af11-fe69eadc54d7" -d '{"events": [{"name": "network-changed", "server_uuid": "1aa7ec26-0d3e-4d40-87d2-45e63ed435eb", "tag": "e97fd0d3-216a-4615-aa4a-a98857cba123"}]}' {{(pid=109040) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:52:12.897800 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49576) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:12.941174 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c1826075-f824-4167-ac88-dab6e65e855e admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:12.967089 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-2d753b42-bb69-4a20-8d15-9124961effca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:12.967477 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-d6d02218-30f7-448f-a278-353c58d0b4a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:12.968785 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-d6d02218-30f7-448f-a278-353c58d0b4a9 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0 HTTP/1.1" status: 200 len: 850 time: 0.0993989 Nov 21 13:52:13.040571 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] For port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:52:13.078887 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b6a10f93-74f2-4aa6-8de7-07e163139461 req-20202642-5965-4954-b081-28381115408e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 210 time: 0.0814893 Nov 21 13:52:13.080558 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-cae905dd-97bb-43c2-a0a1-ccae4a417451 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:13.082631 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-cae905dd-97bb-43c2-a0a1-ccae4a417451 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=ea19090b-8034-4904-8b6c-1752befe0b5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0999322 Nov 21 13:52:13.108849 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] For port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5,segment=NetworkSegment(87188554-865b-4f60-ac47-7f9dc768573f),segment_id=87188554-865b-4f60-ac47-7f9dc768573f)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:52:13.111066 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-2d753b42-bb69-4a20-8d15-9124961effca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Network 24c864ef-5c5a-4df8-8968-78a7fe30b188 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:52:13.112279 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-529124c9-ddbb-4080-ba71-52c80a7e988e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Allocated IP 172.20.0.6 (63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a/a7f1c544-97e5-450d-9032-daf1d5a3a2a3/dcf844c6-0002-4d63-9e63-4bf56191c807) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:52:13.116610 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c1826075-f824-4167-ac88-dab6e65e855e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:13.121471 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-2d753b42-bb69-4a20-8d15-9124961effca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:52:13.124156 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:13.127480 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c1826075-f824-4167-ac88-dab6e65e855e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:13.131830 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-2d753b42-bb69-4a20-8d15-9124961effca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:52:13.134064 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d753b42-bb69-4a20-8d15-9124961effca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event updated for resources: {'Port': ['ID=627d561d-d2ff-449e-a99f-9e5e3fd874ba,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:13.214934 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1826075-f824-4167-ac88-dab6e65e855e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3be74ab-c7b6-4026-a14b-9aeaef33c78a,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:13.227236 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-c1826075-f824-4167-ac88-dab6e65e855e admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=dbfaa1ffe5b648e985265c8703c25a8e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3190117 Nov 21 13:52:13.227422 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 49590) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:13.232020 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:13.233168 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:13.235340 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] 10.222.0.50 "PUT /v2.0/ports/e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 HTTP/1.1" status: 200 len: 1093 time: 3.4039743 Nov 21 13:52:13.286087 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2d1c9d3d-f088-4d2f-b2bc-e26543509aae', 'tag': 'e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:52:13.310944 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec9a05eb-58fd-4d8e-b4d0-46934823a244" -d '{"events": [{"name": "network-changed", "server_uuid": "2d1c9d3d-f088-4d2f-b2bc-e26543509aae", "tag": "e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:52:13.413844 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-eeb0322e-502a-4bb8-9071-4070bc147524 service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3173838 Nov 21 13:52:13.434520 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:52:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6958899e-c3ef-48d3-aa54-0d39c4b72a43 x-openstack-request-id: req-6958899e-c3ef-48d3-aa54-0d39c4b72a43 {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:52:13.434828 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1aa7ec26-0d3e-4d40-87d2-45e63ed435eb", "tag": "e97fd0d3-216a-4615-aa4a-a98857cba123", "status": "completed", "code": 200}]} {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:52:13.435070 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-6958899e-c3ef-48d3-aa54-0d39c4b72a43 {{(pid=109040) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:52:13.435549 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1aa7ec26-0d3e-4d40-87d2-45e63ed435eb', 'tag': 'e97fd0d3-216a-4615-aa4a-a98857cba123', 'status': 'completed', 'code': 200} Nov 21 13:52:13.511949 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:52:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4f299e52-4be5-49fa-a082-4b411db411cd x-openstack-request-id: req-4f299e52-4be5-49fa-a082-4b411db411cd {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:52:13.512510 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f7ac629e-e375-4954-82d0-1efb9da7da3b", "name": "network-vif-plugged", "status": "completed", "tag": "8653e663-5da8-4b7e-91b0-8c94d45d51ad", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:52:13.512621 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-4f299e52-4be5-49fa-a082-4b411db411cd {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:52:13.513316 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f7ac629e-e375-4954-82d0-1efb9da7da3b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8653e663-5da8-4b7e-91b0-8c94d45d51ad', 'code': 200} Nov 21 13:52:13.564279 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e94743bb-9851-44b3-ade0-3b9a506f1c7e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:13.593006 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-2d753b42-bb69-4a20-8d15-9124961effca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:13.594665 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-2d753b42-bb69-4a20-8d15-9124961effca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:13.598257 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e94743bb-9851-44b3-ade0-3b9a506f1c7e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:13.619832 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:52:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27700a19-1fff-41c5-bf9c-5b512e46f795 x-openstack-request-id: req-27700a19-1fff-41c5-bf9c-5b512e46f795 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:52:13.620488 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2d1c9d3d-f088-4d2f-b2bc-e26543509aae", "tag": "e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:52:13.620940 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-27700a19-1fff-41c5-bf9c-5b512e46f795 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:52:13.621519 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2d1c9d3d-f088-4d2f-b2bc-e26543509aae', 'tag': 'e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5', 'status': 'completed', 'code': 200} Nov 21 13:52:13.631111 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-62fa546e-2748-4606-a7bd-f954ab5eb769 None None] Provisioning complete for port 627d561d-d2ff-449e-a99f-9e5e3fd874ba triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:52:13.631588 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-62fa546e-2748-4606-a7bd-f954ab5eb769 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:13.655000 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f4f22fc-40a6-4fa3-b7d9-8ceea63d353a service neutron] Pushing event updated for resources: {'Port': ['ID=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:13.670345 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-78d777a7-fec4-42da-ad74-07bc1d6c7dc2 req-a26345b2-5983-4752-a93a-ad70b91d2adc service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2338476 Nov 21 13:52:13.690117 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-2d753b42-bb69-4a20-8d15-9124961effca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.4565246 Nov 21 13:52:13.697238 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d5b4801-832c-4da1-a198-020c040d663c req-c366d472-b65f-4bea-918f-b9de1a64b496 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:13.698659 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-c366d472-b65f-4bea-918f-b9de1a64b496 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=c90104f2696540809e93549d7ed3695f&device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 1096 time: 0.3631322 Nov 21 13:52:13.700591 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-62fa546e-2748-4606-a7bd-f954ab5eb769 None None] Port 627d561d-d2ff-449e-a99f-9e5e3fd874ba cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:52:13.710845 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Request body: {'port': {'device_id': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:52:13.721549 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e94743bb-9851-44b3-ade0-3b9a506f1c7e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:13.723964 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e94743bb-9851-44b3-ade0-3b9a506f1c7e admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:13.727661 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-e94743bb-9851-44b3-ade0-3b9a506f1c7e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/b3be74ab-c7b6-4026-a14b-9aeaef33c78a HTTP/1.1" status: 204 len: 168 time: 0.4967382 Nov 21 13:52:13.750791 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.50', 61816) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:13.762307 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e94743bb-9851-44b3-ade0-3b9a506f1c7e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3be74ab-c7b6-4026-a14b-9aeaef33c78a,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:13.793354 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-514857e3-0c5f-455d-a0b8-35a137fbbbe6 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 HTTP/1.1" status: 200 len: 217 time: 0.0764232 Nov 21 13:52:13.804650 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-019f3e65-def8-412e-9cc3-d64f412c98fa req-3ed08b0b-309e-44a0-87fa-92dd9ab85f1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:13.804834 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b39c40d-e6d6-46de-8c10-1ca6f06034d1 req-7e013b6a-dd03-4359-b8e2-64afcd387447 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:13.806117 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-019f3e65-def8-412e-9cc3-d64f412c98fa req-3ed08b0b-309e-44a0-87fa-92dd9ab85f1d service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 1098 time: 0.1176910 Nov 21 13:52:13.806263 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6b39c40d-e6d6-46de-8c10-1ca6f06034d1 req-7e013b6a-dd03-4359-b8e2-64afcd387447 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 932 time: 0.2360847 Nov 21 13:52:13.812270 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-ed65ff28-307c-4631-a58c-0b6accd1cf27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:13.814010 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-ed65ff28-307c-4631-a58c-0b6accd1cf27 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=389c281a19bb49e583633f57108f7f69&device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 1096 time: 0.0615237 Nov 21 13:52:13.864748 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-529124c9-ddbb-4080-ba71-52c80a7e988e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:13.886370 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-019f3e65-def8-412e-9cc3-d64f412c98fa req-286c59df-eec5-417a-bd87-134a4fe2a628 service neutron] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:13.924811 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:13.943934 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d5b4801-832c-4da1-a198-020c040d663c req-0f7a8beb-ff41-4bf5-a4ed-4f51d05cc5eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:13.945595 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-0f7a8beb-ff41-4bf5-a4ed-4f51d05cc5eb service neutron] 10.222.0.50 "GET /v2.0/subnets?id=a7f1c544-97e5-450d-9032-daf1d5a3a2a3 HTTP/1.1" status: 200 len: 858 time: 0.1342320 Nov 21 13:52:13.969188 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6b39c40d-e6d6-46de-8c10-1ca6f06034d1 req-22a94e48-b17a-48ec-a41f-dac41390cfd2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1373835 Nov 21 13:52:14.027196 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-529124c9-ddbb-4080-ba71-52c80a7e988e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:14.054809 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-7f98ebf0-a979-4d75-98b9-7e069cf73277 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:14.056280 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-7f98ebf0-a979-4d75-98b9-7e069cf73277 service neutron] 10.222.0.50 "GET /v2.0/networks?id=ea19090b-8034-4904-8b6c-1752befe0b5a HTTP/1.1" status: 200 len: 912 time: 0.2351956 Nov 21 13:52:14.087433 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36fb3f43-8585-46f2-abf9-460833d8dca4 req-f24f45e6-5a67-4016-a02d-ffb32c3d3d13 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:14.089063 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-36fb3f43-8585-46f2-abf9-460833d8dca4 req-f24f45e6-5a67-4016-a02d-ffb32c3d3d13 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 943 time: 0.1330931 Nov 21 13:52:14.142345 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-019f3e65-def8-412e-9cc3-d64f412c98fa req-286c59df-eec5-417a-bd87-134a4fe2a628 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:14.150112 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-019f3e65-def8-412e-9cc3-d64f412c98fa req-286c59df-eec5-417a-bd87-134a4fe2a628 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:14.345588 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-529124c9-ddbb-4080-ba71-52c80a7e988e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:52:14.362107 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-529124c9-ddbb-4080-ba71-52c80a7e988e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:52:14.366336 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-019f3e65-def8-412e-9cc3-d64f412c98fa req-286c59df-eec5-417a-bd87-134a4fe2a628 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5512409 Nov 21 13:52:14.367106 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-529124c9-ddbb-4080-ba71-52c80a7e988e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Pushing event updated for resources: {'Port': ['ID=dcf844c6-0002-4d63-9e63-4bf56191c807,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:14.371388 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-529124c9-ddbb-4080-ba71-52c80a7e988e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:52:14.383474 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-36fb3f43-8585-46f2-abf9-460833d8dca4 req-50b1eaff-c6ef-47b2-b3f7-5541f6ceebf8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2873602 Nov 21 13:52:14.384783 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-286c59df-eec5-417a-bd87-134a4fe2a628 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=f35575f4-1deb-481b-a8e4-72cc55add6ac,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:14.477270 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a62fa1b1-fde0-4dd3-9f00-1a1e7cf3db0e req-916617db-a9b6-4486-a3ae-ab1ebd9467f3 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:14.478703 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a62fa1b1-fde0-4dd3-9f00-1a1e7cf3db0e req-916617db-a9b6-4486-a3ae-ab1ebd9467f3 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.1880078 Nov 21 13:52:14.492478 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-529124c9-ddbb-4080-ba71-52c80a7e988e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:14.493141 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-529124c9-ddbb-4080-ba71-52c80a7e988e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:14.531966 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d69921b-f462-4258-a167-30a8e72e368f req-f3e77f5c-4e79-4706-ab65-5c8d3653ef6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:14.533474 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8d69921b-f462-4258-a167-30a8e72e368f req-f3e77f5c-4e79-4706-ab65-5c8d3653ef6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 931 time: 0.0799472 Nov 21 13:52:14.563864 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-529124c9-ddbb-4080-ba71-52c80a7e988e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.8184357 Nov 21 13:52:14.632842 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a62fa1b1-fde0-4dd3-9f00-1a1e7cf3db0e req-4ee7240e-336c-4cb6-adb2-ff050a28aeec tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1477654 Nov 21 13:52:14.647723 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8d69921b-f462-4258-a167-30a8e72e368f req-15bb9b29-5836-40d1-8927-02e23888d1c9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0990026 Nov 21 13:52:14.693926 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 627d561d-d2ff-449e-a99f-9e5e3fd874ba {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:52:14.703078 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:14.717472 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Transition to ACTIVE for port object 627d561d-d2ff-449e-a99f-9e5e3fd874ba will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:52:14.722059 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:14.776017 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Pushing event updated for resources: {'Port': ['ID=627d561d-d2ff-449e-a99f-9e5e3fd874ba,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:14.874709 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Attempting to bind port 627d561d-d2ff-449e-a99f-9e5e3fd874ba on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:52:14.875272 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Attempting to bind port 627d561d-d2ff-449e-a99f-9e5e3fd874ba by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:52:14.875385 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Attempting to bind port 627d561d-d2ff-449e-a99f-9e5e3fd874ba on network 24c864ef-5c5a-4df8-8968-78a7fe30b188 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:52:14.880863 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Port 627d561d-d2ff-449e-a99f-9e5e3fd874ba on network 24c864ef-5c5a-4df8-8968-78a7fe30b188 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:52:14.881196 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Attempting to bind port 627d561d-d2ff-449e-a99f-9e5e3fd874ba on network 24c864ef-5c5a-4df8-8968-78a7fe30b188 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:52:14.886026 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 51, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:52:14.886369 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Checking segment: {'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:52:14.886764 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Bound using segment: {'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:52:14.887197 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Bound port: 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:52:14.887559 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:14.954195 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] For port 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:52:14.957260 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] For port 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:52:14.961038 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:14.995734 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:14.996424 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:14.997780 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] 10.222.0.50 "PUT /v2.0/ports/627d561d-d2ff-449e-a99f-9e5e3fd874ba HTTP/1.1" status: 200 len: 1094 time: 1.2951016 Nov 21 13:52:15.033717 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ad93eaf-c166-4893-b348-f175a4d183ec service neutron] Pushing event updated for resources: {'Port': ['ID=627d561d-d2ff-449e-a99f-9e5e3fd874ba,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:15.128060 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c62d1b7-51ff-4905-b2a2-116621337474 req-fb515c18-2dd1-4b94-a24b-6b7a27f55a68 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:15.130436 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c62d1b7-51ff-4905-b2a2-116621337474 req-fb515c18-2dd1-4b94-a24b-6b7a27f55a68 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0643957 Nov 21 13:52:15.181651 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c62d1b7-51ff-4905-b2a2-116621337474 req-9292251b-24db-4986-89ea-a9b906ba000e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436721 Nov 21 13:52:15.507679 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b55fcff-f0b2-4478-8242-ce3d43ff3326 req-078df75a-e9de-4849-9e64-3a16feb92e1a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:15.509097 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5b55fcff-f0b2-4478-8242-ce3d43ff3326 req-078df75a-e9de-4849-9e64-3a16feb92e1a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 943 time: 0.0495169 Nov 21 13:52:15.557061 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5b55fcff-f0b2-4478-8242-ce3d43ff3326 req-06ede8fc-667c-421a-b0ed-35f23bbd00e3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416236 Nov 21 13:52:15.623118 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:52:15.625478 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4f191cfb-ae21-44a0-80de-f07adca4235b" -d '{"events": [{"name": "network-changed", "server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:52:15.659643 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:52:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fa3937f0-71e2-42ed-aa83-e9b1174fb52c x-openstack-request-id: req-fa3937f0-71e2-42ed-aa83-e9b1174fb52c {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:52:15.660890 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:52:15.660890 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-fa3937f0-71e2-42ed-aa83-e9b1174fb52c {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:52:15.661722 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'status': 'completed', 'code': 200} Nov 21 13:52:15.747490 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a6981e-170f-479a-a6da-0138fc60e06a req-91e8c893-4b23-4b9e-8b5e-ce1141f6d052 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:15.749073 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d1a6981e-170f-479a-a6da-0138fc60e06a req-91e8c893-4b23-4b9e-8b5e-ce1141f6d052 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0516081 Nov 21 13:52:15.755675 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ada5b0d5-b0f4-49c3-b977-5a9c4efeb8f8 req-40cdde07-65ba-4125-bdbf-0d2d3c1c7afc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:15.757214 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ada5b0d5-b0f4-49c3-b977-5a9c4efeb8f8 req-40cdde07-65ba-4125-bdbf-0d2d3c1c7afc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 931 time: 0.0505877 Nov 21 13:52:15.818395 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d1a6981e-170f-479a-a6da-0138fc60e06a req-11006eeb-e6a8-46f5-b48b-2573f3efa98e tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625944 Nov 21 13:52:15.822810 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ada5b0d5-b0f4-49c3-b977-5a9c4efeb8f8 req-39b06064-7da6-4a02-8fcc-85aaabbe2f7b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0588024 Nov 21 13:52:16.296989 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74e6ce39-5d7b-4e52-a0aa-f58c762ab552 req-e44fd5ca-8cfb-49cd-b60c-2d120252563a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:16.298436 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-74e6ce39-5d7b-4e52-a0aa-f58c762ab552 req-e44fd5ca-8cfb-49cd-b60c-2d120252563a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0477839 Nov 21 13:52:16.344308 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-74e6ce39-5d7b-4e52-a0aa-f58c762ab552 req-116c7e4d-cb85-481d-93ec-2a4fb9286a54 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398571 Nov 21 13:52:16.670378 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5d5e787-8a9c-4c5c-a2e6-4b3904be561d req-60cb92bc-91f1-4e63-a453-69600685c339 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:16.671860 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b5d5e787-8a9c-4c5c-a2e6-4b3904be561d req-60cb92bc-91f1-4e63-a453-69600685c339 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 943 time: 0.0505974 Nov 21 13:52:16.719581 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b5d5e787-8a9c-4c5c-a2e6-4b3904be561d req-22b9cd7e-2788-400a-b7e0-326251ffef3b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409811 Nov 21 13:52:16.915708 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Request body: {'port': {'device_id': 'e6f04799-b287-41b6-9756-b259d5eeddeb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:52:16.941300 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-4addf6bb-7cba-4208-b301-213392fc4485 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0578046 Nov 21 13:52:16.970025 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-ec4da391-0c02-4d36-ae07-e3635f1eb4c0 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e97fd0d3-216a-4615-aa4a-a98857cba123 HTTP/1.1" status: 200 len: 217 time: 0.0645013 Nov 21 13:52:16.994802 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cffebce3-ad9b-41df-8798-ba4d55e24b15 req-82f4bdab-942e-46ea-95de-5646c166e8da tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:16.996280 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-cffebce3-ad9b-41df-8798-ba4d55e24b15 req-82f4bdab-942e-46ea-95de-5646c166e8da tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 931 time: 0.1049969 Nov 21 13:52:17.047483 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-075a1a6f-1312-4059-a851-169577ad7e3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:17.048945 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-075a1a6f-1312-4059-a851-169577ad7e3c service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0 HTTP/1.1" status: 200 len: 850 time: 0.0691414 Nov 21 13:52:17.070061 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-cffebce3-ad9b-41df-8798-ba4d55e24b15 req-9ba1c240-a235-4459-8580-c216ad6d165c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548890 Nov 21 13:52:17.096635 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:17.119011 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6543a679-49db-4d15-810f-21d8d41aed30 req-6c9a1788-3fd7-479e-84ae-69bee9fb4c66 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:17.120565 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6543a679-49db-4d15-810f-21d8d41aed30 req-6c9a1788-3fd7-479e-84ae-69bee9fb4c66 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.2166982 Nov 21 13:52:17.134267 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f191cfb-ae21-44a0-80de-f07adca4235b req-2aa0da48-53f2-41bb-9645-ffebab1e3416 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:17.135765 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4f191cfb-ae21-44a0-80de-f07adca4235b req-2aa0da48-53f2-41bb-9645-ffebab1e3416 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 1097 time: 0.1779861 Nov 21 13:52:17.197574 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-9548b684-d8a7-453a-aa8e-13ab913ddc01 service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2380402 Nov 21 13:52:17.233176 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6543a679-49db-4d15-810f-21d8d41aed30 req-562fa0c4-bdf8-436d-a6b2-9291b6b035e9 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0951967 Nov 21 13:52:17.430622 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dcf844c6-0002-4d63-9e63-4bf56191c807 {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:52:17.439038 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:17.452058 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Transition to ACTIVE for port object dcf844c6-0002-4d63-9e63-4bf56191c807 will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:52:17.455872 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:17.464036 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23316add-fb7a-4329-b50c-ceff79a01a71 req-72aed820-a70d-468a-8241-d9059a933ee4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:17.468249 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-23316add-fb7a-4329-b50c-ceff79a01a71 req-72aed820-a70d-468a-8241-d9059a933ee4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0542958 Nov 21 13:52:17.505741 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Pushing event updated for resources: {'Port': ['ID=dcf844c6-0002-4d63-9e63-4bf56191c807,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:17.516977 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-23316add-fb7a-4329-b50c-ceff79a01a71 req-6fee760f-e1f1-4713-9645-9ea5122649ae tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455821 Nov 21 13:52:17.573316 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Attempting to bind port dcf844c6-0002-4d63-9e63-4bf56191c807 on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:52:17.573652 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Attempting to bind port dcf844c6-0002-4d63-9e63-4bf56191c807 by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '87188554-865b-4f60-ac47-7f9dc768573f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:52:17.573977 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Attempting to bind port dcf844c6-0002-4d63-9e63-4bf56191c807 on network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:52:17.578073 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Port dcf844c6-0002-4d63-9e63-4bf56191c807 on network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:52:17.578414 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Attempting to bind port dcf844c6-0002-4d63-9e63-4bf56191c807 on network 63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:52:17.583799 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 51, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:52:17.584206 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Checking segment: {'id': '87188554-865b-4f60-ac47-7f9dc768573f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:52:17.584592 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Bound using segment: {'id': '87188554-865b-4f60-ac47-7f9dc768573f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:52:17.585017 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Bound port: dcf844c6-0002-4d63-9e63-4bf56191c807, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '87188554-865b-4f60-ac47-7f9dc768573f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 521, 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:52:17.585368 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:17.647283 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] For port dcf844c6-0002-4d63-9e63-4bf56191c807, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:52:17.650335 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] For port dcf844c6-0002-4d63-9e63-4bf56191c807, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=dcf844c6-0002-4d63-9e63-4bf56191c807,segment=NetworkSegment(87188554-865b-4f60-ac47-7f9dc768573f),segment_id=87188554-865b-4f60-ac47-7f9dc768573f)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:52:17.655635 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:17.690817 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:17.692053 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:17.693467 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] 10.222.0.50 "PUT /v2.0/ports/dcf844c6-0002-4d63-9e63-4bf56191c807 HTTP/1.1" status: 200 len: 1093 time: 0.7920780 Nov 21 13:52:17.693902 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e6f04799-b287-41b6-9756-b259d5eeddeb', 'tag': 'dcf844c6-0002-4d63-9e63-4bf56191c807'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:52:17.696155 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f94f3e6-11f2-4be3-9e0b-51f887061906" -d '{"events": [{"name": "network-changed", "server_uuid": "e6f04799-b287-41b6-9756-b259d5eeddeb", "tag": "dcf844c6-0002-4d63-9e63-4bf56191c807"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:52:17.718331 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3a65f55-ce15-4e6b-b39c-120159841792 service neutron] Pushing event updated for resources: {'Port': ['ID=dcf844c6-0002-4d63-9e63-4bf56191c807,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:17.734498 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:52:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-28259fc3-3d1e-4091-a1f8-824f7aeffccf x-openstack-request-id: req-28259fc3-3d1e-4091-a1f8-824f7aeffccf {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:52:17.734802 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e6f04799-b287-41b6-9756-b259d5eeddeb", "tag": "dcf844c6-0002-4d63-9e63-4bf56191c807", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:52:17.735059 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-28259fc3-3d1e-4091-a1f8-824f7aeffccf {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:52:17.735461 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e6f04799-b287-41b6-9756-b259d5eeddeb', 'tag': 'dcf844c6-0002-4d63-9e63-4bf56191c807', 'status': 'completed', 'code': 200} Nov 21 13:52:17.831371 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-600935ec-7b77-466a-80a2-801f4c34a08e req-2864de0d-8aec-4cab-93c0-0e2c7ecc9652 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:17.833454 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-600935ec-7b77-466a-80a2-801f4c34a08e req-2864de0d-8aec-4cab-93c0-0e2c7ecc9652 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 943 time: 0.0481207 Nov 21 13:52:17.883331 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-600935ec-7b77-466a-80a2-801f4c34a08e req-47ec9182-ea36-47a2-9f9c-24f1ef291df5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431600 Nov 21 13:52:18.186496 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e062493-815b-402c-92cc-a6c72d9564db req-bc022ee7-3921-4e15-999a-7181b2ef19ef tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:18.187983 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2e062493-815b-402c-92cc-a6c72d9564db req-bc022ee7-3921-4e15-999a-7181b2ef19ef tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 943 time: 0.0511158 Nov 21 13:52:18.233403 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2e062493-815b-402c-92cc-a6c72d9564db req-15077b41-b2e6-4fc7-8c0f-9c4c811e4507 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389028 Nov 21 13:52:18.344053 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66084c7a-9d45-49fe-adc3-069e0f10b244 req-616bd2f3-1372-452b-8ed9-b8cfadb2b52d tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:18.345487 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-66084c7a-9d45-49fe-adc3-069e0f10b244 req-616bd2f3-1372-452b-8ed9-b8cfadb2b52d tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0470774 Nov 21 13:52:18.391299 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-66084c7a-9d45-49fe-adc3-069e0f10b244 req-a4cab68b-0c87-4bc7-9c08-f30d12b9bb62 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393810 Nov 21 13:52:18.632145 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-746df8d1-da56-4eee-bf35-6d7a1bf72509 req-e70a92bf-d036-4835-bf03-7064d7e6116c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:18.633591 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-746df8d1-da56-4eee-bf35-6d7a1bf72509 req-e70a92bf-d036-4835-bf03-7064d7e6116c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0476251 Nov 21 13:52:18.679357 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-746df8d1-da56-4eee-bf35-6d7a1bf72509 req-8a4066e0-6d50-4592-879a-5f527853cfc7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398834 Nov 21 13:52:18.998709 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d342945-e782-425f-b9b2-ccfa14c08f9e req-f1d5cb00-fdc4-4aff-a48f-bcf989fba8cb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:19.000172 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3d342945-e782-425f-b9b2-ccfa14c08f9e req-f1d5cb00-fdc4-4aff-a48f-bcf989fba8cb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 943 time: 0.0508597 Nov 21 13:52:19.048441 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3d342945-e782-425f-b9b2-ccfa14c08f9e req-341a3881-bbb0-4f33-a5d1-c5f96ce341e8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416105 Nov 21 13:52:19.354353 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c75cd72-0e22-413a-9ca3-e7ca6bdfdfa8 req-bafddf87-1921-47a6-8a9b-8eb006e17a47 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:19.355855 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8c75cd72-0e22-413a-9ca3-e7ca6bdfdfa8 req-bafddf87-1921-47a6-8a9b-8eb006e17a47 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 943 time: 0.0552647 Nov 21 13:52:19.402494 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8c75cd72-0e22-413a-9ca3-e7ca6bdfdfa8 req-a125059a-ae5a-485d-bdd9-33b2694ab714 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406907 Nov 21 13:52:19.505319 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf97503-1e90-4a97-9981-3de10036d7e5 req-67dc1311-134f-420e-8a2a-ef28432abd45 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:19.506780 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-caf97503-1e90-4a97-9981-3de10036d7e5 req-67dc1311-134f-420e-8a2a-ef28432abd45 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0490344 Nov 21 13:52:19.561351 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-caf97503-1e90-4a97-9981-3de10036d7e5 req-9383c807-6b8a-46e0-b815-68d661865d35 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486116 Nov 21 13:52:19.794796 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7945844-3bbc-4a03-a462-3722a980348d req-3f56747a-5afd-4157-b4d6-b249bdb2110a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:19.796269 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b7945844-3bbc-4a03-a462-3722a980348d req-3f56747a-5afd-4157-b4d6-b249bdb2110a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0482190 Nov 21 13:52:19.842291 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b7945844-3bbc-4a03-a462-3722a980348d req-b565f0b6-8fe1-4315-b3b9-d7285b14a77c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396185 Nov 21 13:52:20.051604 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-258fdb39-82f4-4b75-9c24-71a30ba6cd89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:20.053147 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-258fdb39-82f4-4b75-9c24-71a30ba6cd89 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=ea19090b-8034-4904-8b6c-1752befe0b5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0447662 Nov 21 13:52:20.190547 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c520a6-eeb9-4efe-831d-ad9107144300 req-4c9bcca9-bf8a-431d-8487-1bbe725060ec tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:20.193303 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-98c520a6-eeb9-4efe-831d-ad9107144300 req-4c9bcca9-bf8a-431d-8487-1bbe725060ec tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 943 time: 0.0696194 Nov 21 13:52:20.195393 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-c3549e3b-1633-4f9e-95bf-3e6280880f36 service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1314240 Nov 21 13:52:20.240218 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f94f3e6-11f2-4be3-9e0b-51f887061906 req-68757712-06fa-4363-abd0-4f3895b2e622 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:20.241683 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1f94f3e6-11f2-4be3-9e0b-51f887061906 req-68757712-06fa-4363-abd0-4f3895b2e622 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=c90104f2696540809e93549d7ed3695f&device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 1096 time: 0.1997631 Nov 21 13:52:20.298080 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-98c520a6-eeb9-4efe-831d-ad9107144300 req-b961edca-3680-4e16-803e-2282528bdd93 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0969994 Nov 21 13:52:20.327714 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-404be6e4-49ad-4d25-84f2-05e6b134e098 service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1197703 Nov 21 13:52:20.520833 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6d5b4801-832c-4da1-a198-020c040d663c req-de7c29e2-328f-419f-982f-df6f6e82d105 service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4982398 Nov 21 13:52:20.522866 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f191cfb-ae21-44a0-80de-f07adca4235b req-20c4b920-09cb-4e67-bf25-6e6fa57eaa99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:20.524279 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4f191cfb-ae21-44a0-80de-f07adca4235b req-20c4b920-09cb-4e67-bf25-6e6fa57eaa99 service neutron] 10.222.0.50 "GET /v2.0/networks?tenant_id=3d25ecbdc2ba435488271022d897a406&shared=False HTTP/1.1" status: 200 len: 918 time: 0.5050540 Nov 21 13:52:20.591831 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b79dc846-86dd-4e20-8b77-dfc99c91c9f6 req-3d36c2ed-eea3-4798-abe4-e381b42fdaa2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:20.593310 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b79dc846-86dd-4e20-8b77-dfc99c91c9f6 req-3d36c2ed-eea3-4798-abe4-e381b42fdaa2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 943 time: 0.0914726 Nov 21 13:52:20.594709 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f94f3e6-11f2-4be3-9e0b-51f887061906 req-19715e71-dddd-4496-9d3d-7bb938c5ea40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:20.596050 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1f94f3e6-11f2-4be3-9e0b-51f887061906 req-19715e71-dddd-4496-9d3d-7bb938c5ea40 service neutron] 10.222.0.50 "GET /v2.0/networks?tenant_id=c90104f2696540809e93549d7ed3695f&shared=False HTTP/1.1" status: 200 len: 919 time: 0.3410025 Nov 21 13:52:20.617661 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:52:20.641540 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b79dc846-86dd-4e20-8b77-dfc99c91c9f6 req-170d8ef5-d8c5-441e-83c9-4a6c141020e8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417566 Nov 21 13:52:20.677677 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a05798cf-4a03-4d0f-bd46-f0ddc3c26bca req-54c6c911-6f6f-4667-929d-eb8b92e72673 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:20.679134 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a05798cf-4a03-4d0f-bd46-f0ddc3c26bca req-54c6c911-6f6f-4667-929d-eb8b92e72673 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0496049 Nov 21 13:52:20.728877 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a05798cf-4a03-4d0f-bd46-f0ddc3c26bca req-acc2d56f-f82b-418a-a009-7b5e01973f6f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437462 Nov 21 13:52:20.965391 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-423f61f9-ddfc-4f7f-90f3-7010e469af56 req-359a3891-fde1-420c-bdcc-59ff26784e3d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:20.966820 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-423f61f9-ddfc-4f7f-90f3-7010e469af56 req-359a3891-fde1-420c-bdcc-59ff26784e3d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0497348 Nov 21 13:52:21.013323 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-423f61f9-ddfc-4f7f-90f3-7010e469af56 req-e46dbdab-a71f-4d78-93c2-3b692ceb4c28 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400469 Nov 21 13:52:21.411728 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c96a653-90c2-4bbf-8d0d-5327c094b375 req-0d01e527-b77a-476d-9fc9-a05b5628f3f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:21.413212 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8c96a653-90c2-4bbf-8d0d-5327c094b375 req-0d01e527-b77a-476d-9fc9-a05b5628f3f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 943 time: 0.0482051 Nov 21 13:52:21.459676 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8c96a653-90c2-4bbf-8d0d-5327c094b375 req-adca7d47-0d91-4fee-8d07-f0113929499c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404856 Nov 21 13:52:21.751412 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4d1151-c656-4008-9ea8-3064fd78f1c5 req-84df9d70-8cf5-422c-9c29-5eecb2449bca tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:21.753211 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1a4d1151-c656-4008-9ea8-3064fd78f1c5 req-84df9d70-8cf5-422c-9c29-5eecb2449bca tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 943 time: 0.0465641 Nov 21 13:52:21.804437 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1a4d1151-c656-4008-9ea8-3064fd78f1c5 req-ca856ab2-d46e-4438-86a0-a1366b6e7e43 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410638 Nov 21 13:52:21.849132 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-515df84b-fbd9-4041-a092-faa65da54ea5 req-7290978a-f7c2-4a10-98a8-8903e9678957 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:21.850603 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-515df84b-fbd9-4041-a092-faa65da54ea5 req-7290978a-f7c2-4a10-98a8-8903e9678957 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0510015 Nov 21 13:52:21.899509 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-515df84b-fbd9-4041-a092-faa65da54ea5 req-c2080a3b-f684-4c1e-a0a5-714616dff12c tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430427 Nov 21 13:52:22.136049 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8e42637-905b-492a-828d-69be07ff7893 req-dd00c073-7aad-464c-ac3c-afb728fc6e46 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:22.137520 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d8e42637-905b-492a-828d-69be07ff7893 req-dd00c073-7aad-464c-ac3c-afb728fc6e46 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0532932 Nov 21 13:52:22.183404 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d8e42637-905b-492a-828d-69be07ff7893 req-5c9e9827-0d03-458d-b0b0-aef35ec521f2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401828 Nov 21 13:52:22.460528 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:22.573113 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3636f1f4-349b-46dd-8486-13901fa03dee req-4d41f289-4e52-4457-b27f-8ddf494d3cfe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:22.574558 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3636f1f4-349b-46dd-8486-13901fa03dee req-4d41f289-4e52-4457-b27f-8ddf494d3cfe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 943 time: 0.0507228 Nov 21 13:52:22.621533 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3636f1f4-349b-46dd-8486-13901fa03dee req-7b099c80-956f-47a4-a843-389b701534e4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407958 Nov 21 13:52:22.914854 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-262487b7-bac6-425c-9ad2-2d752e158972 req-5b700eb5-19a5-4c1b-9538-d160549c2a51 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:22.916322 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-262487b7-bac6-425c-9ad2-2d752e158972 req-5b700eb5-19a5-4c1b-9538-d160549c2a51 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 943 time: 0.0472116 Nov 21 13:52:22.963542 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-262487b7-bac6-425c-9ad2-2d752e158972 req-24b33434-b8f6-4790-9b3f-90c4af660bdd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412068 Nov 21 13:52:23.009493 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-167f25b5-3c89-4852-833b-4cc1c79506fc req-6099eeaa-f538-43fb-9bc0-6d22915be830 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:23.010943 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-167f25b5-3c89-4852-833b-4cc1c79506fc req-6099eeaa-f538-43fb-9bc0-6d22915be830 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0472453 Nov 21 13:52:23.055932 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-167f25b5-3c89-4852-833b-4cc1c79506fc req-de283888-3915-4f3c-bded-a41acf24141f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390265 Nov 21 13:52:23.296758 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3245234a-4fae-47ff-98ce-1d7b1e966ee3 req-f49140b9-819e-49c9-ad07-b98e28847e46 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:23.298201 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3245234a-4fae-47ff-98ce-1d7b1e966ee3 req-f49140b9-819e-49c9-ad07-b98e28847e46 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0479167 Nov 21 13:52:23.346926 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3245234a-4fae-47ff-98ce-1d7b1e966ee3 req-2521730a-b38f-4419-88f0-abf00df8ed61 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422311 Nov 21 13:52:23.442094 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device e97fd0d3-216a-4615-aa4a-a98857cba123 details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:52:23.536161 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port e97fd0d3-216a-4615-aa4a-a98857cba123, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=e97fd0d3-216a-4615-aa4a-a98857cba123,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:23.547258 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': 'e97fd0d3-216a-4615-aa4a-a98857cba123', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'port_id': 'e97fd0d3-216a-4615-aa4a-a98857cba123', 'mac_address': 'fa:16:3e:e6:7f:4d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 507, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:52:23.584226 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:23.597972 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e97fd0d3-216a-4615-aa4a-a98857cba123 {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:52:23.621116 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port e97fd0d3-216a-4615-aa4a-a98857cba123, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=e97fd0d3-216a-4615-aa4a-a98857cba123,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:23.625788 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:23.681682 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=e97fd0d3-216a-4615-aa4a-a98857cba123,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:23.683123 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-3ea821f8-edae-4cd9-9887-074b6a756633 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:23.684637 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-3ea821f8-edae-4cd9-9887-074b6a756633 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=c90104f2696540809e93549d7ed3695f&device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 1096 time: 0.1782496 Nov 21 13:52:23.691261 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f94f3e6-11f2-4be3-9e0b-51f887061906 req-5e395444-2e68-48f2-a9ec-5727e2319904 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:23.692671 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1f94f3e6-11f2-4be3-9e0b-51f887061906 req-5e395444-2e68-48f2-a9ec-5727e2319904 service neutron] 10.222.0.50 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2531133 Nov 21 13:52:23.748741 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07a2e145-ba33-4aaf-a788-02da62217b09 req-72ddf930-9520-4c2b-98bb-7d6092d753c6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:23.750393 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-07a2e145-ba33-4aaf-a788-02da62217b09 req-72ddf930-9520-4c2b-98bb-7d6092d753c6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 944 time: 0.0517328 Nov 21 13:52:23.760365 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f191cfb-ae21-44a0-80de-f07adca4235b req-7007e10f-78cb-44fb-a37c-493a464d21c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:23.761774 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4f191cfb-ae21-44a0-80de-f07adca4235b req-7007e10f-78cb-44fb-a37c-493a464d21c5 service neutron] 10.222.0.50 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2911959 Nov 21 13:52:23.809216 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-07a2e145-ba33-4aaf-a788-02da62217b09 req-5a65fd2e-7063-4cda-ae23-580fd64f60e8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0520804 Nov 21 13:52:23.846145 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-4161c307-46d6-4872-a1d0-218e18d06c44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:23.848230 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-4161c307-46d6-4872-a1d0-218e18d06c44 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=c90104f2696540809e93549d7ed3695f&device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 1096 time: 0.1014156 Nov 21 13:52:23.850676 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-4125dfad-334a-41db-b43a-41b0ce5efc1e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:23.851991 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-4125dfad-334a-41db-b43a-41b0ce5efc1e service neutron] 10.222.0.50 "GET /v2.0/networks?id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a HTTP/1.1" status: 200 len: 919 time: 0.1518040 Nov 21 13:52:23.860876 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['e97fd0d3-216a-4615-aa4a-a98857cba123'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:52:23.865165 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-8dcfaede-ad9a-433c-a03a-4b4920553153 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:23.866591 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-8dcfaede-ad9a-433c-a03a-4b4920553153 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 1097 time: 0.0573602 Nov 21 13:52:23.939349 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-8648a136-06be-4422-be6b-071d8c29be07 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=dcf844c6-0002-4d63-9e63-4bf56191c807 HTTP/1.1" status: 200 len: 217 time: 0.0707529 Nov 21 13:52:23.965245 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-229685c6-c54f-4c0e-a86e-3c58685f1e08 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 HTTP/1.1" status: 200 len: 217 time: 0.0977430 Nov 21 13:52:23.966820 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-883fbe62-a2c3-4ef4-9865-ad32a6a6468b service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba HTTP/1.1" status: 200 len: 217 time: 0.0878315 Nov 21 13:52:24.073812 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c90fd72c-6c91-43d1-8a63-dbab8c021151 req-c1b5fbef-473d-4f60-8755-1ac6caafa481 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:24.075260 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c90fd72c-6c91-43d1-8a63-dbab8c021151 req-c1b5fbef-473d-4f60-8755-1ac6caafa481 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 943 time: 0.0469792 Nov 21 13:52:24.127412 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c90fd72c-6c91-43d1-8a63-dbab8c021151 req-29a0b14c-2740-436d-a632-5bc7ddc151c2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462010 Nov 21 13:52:24.172026 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b891234b-2a7c-4e3b-93de-db19bf2010c4 req-bc64af5e-1a7c-4ae7-a80f-5f86ee97ff4d tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:24.173526 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b891234b-2a7c-4e3b-93de-db19bf2010c4 req-bc64af5e-1a7c-4ae7-a80f-5f86ee97ff4d tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0505872 Nov 21 13:52:24.223662 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b891234b-2a7c-4e3b-93de-db19bf2010c4 req-83b6622f-b679-4569-9922-f8042d029c7a tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429802 Nov 21 13:52:24.476990 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dece38f4-45ba-4b8a-9796-5c64e45f3f8b req-c3d6dedb-beed-4971-9f73-1f47752052aa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:24.478432 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dece38f4-45ba-4b8a-9796-5c64e45f3f8b req-c3d6dedb-beed-4971-9f73-1f47752052aa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0492892 Nov 21 13:52:24.524931 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dece38f4-45ba-4b8a-9796-5c64e45f3f8b req-beb38716-04cb-496f-aa60-4ae549038a2b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405972 Nov 21 13:52:24.930050 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2af6b22-3084-4288-80b7-102735a7f9e7 req-59bfc471-1a22-4875-8577-cb24e1d4fec3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:24.931485 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d2af6b22-3084-4288-80b7-102735a7f9e7 req-59bfc471-1a22-4875-8577-cb24e1d4fec3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 944 time: 0.0515893 Nov 21 13:52:24.976512 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d2af6b22-3084-4288-80b7-102735a7f9e7 req-01ed289a-449a-4c5d-a429-6a126ac89251 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391691 Nov 21 13:52:25.242172 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19785869-1981-4308-9012-4c630edf6146 req-ebf963b4-16e8-4fcf-963b-8a78f7eee573 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:25.243530 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-19785869-1981-4308-9012-4c630edf6146 req-ebf963b4-16e8-4fcf-963b-8a78f7eee573 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 943 time: 0.0475872 Nov 21 13:52:25.290695 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-19785869-1981-4308-9012-4c630edf6146 req-54fdeb34-8d32-4aa2-8d71-4def6f7750f2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411799 Nov 21 13:52:25.338864 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba1b7fa-5c4c-48d6-9b86-8ea2297ad594 req-837a75af-559b-43aa-aa9a-909e57a838de tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:25.340454 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-fba1b7fa-5c4c-48d6-9b86-8ea2297ad594 req-837a75af-559b-43aa-aa9a-909e57a838de tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0510769 Nov 21 13:52:25.386581 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-fba1b7fa-5c4c-48d6-9b86-8ea2297ad594 req-e875168a-70a5-48cb-ae20-e6f855c3091a tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403404 Nov 21 13:52:25.641948 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79396674-468b-45e5-9216-1af375e81e1f req-1c9443c5-43cf-49f5-bb02-3a7151b43819 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:25.643373 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-79396674-468b-45e5-9216-1af375e81e1f req-1c9443c5-43cf-49f5-bb02-3a7151b43819 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0510426 Nov 21 13:52:25.690208 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-79396674-468b-45e5-9216-1af375e81e1f req-e38affde-d3cc-4ed9-a8bd-7c2a978727df tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400436 Nov 21 13:52:26.088673 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-701f1258-b5be-4b13-824a-d89836c581c1 req-2bb89369-c5d9-4b2b-bfc5-ed3b258983db tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:26.090166 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-701f1258-b5be-4b13-824a-d89836c581c1 req-2bb89369-c5d9-4b2b-bfc5-ed3b258983db tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 944 time: 0.0482600 Nov 21 13:52:26.135699 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-701f1258-b5be-4b13-824a-d89836c581c1 req-8314eea4-1071-408e-b189-38c7cc44e9e3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396662 Nov 21 13:52:26.401625 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11647eb3-e25e-4728-867b-89ca3112d993 req-4d9fe97a-b853-4631-bbb5-b347cabc7cc5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:26.403061 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-11647eb3-e25e-4728-867b-89ca3112d993 req-4d9fe97a-b853-4631-bbb5-b347cabc7cc5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 943 time: 0.0479679 Nov 21 13:52:26.455146 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-11647eb3-e25e-4728-867b-89ca3112d993 req-b1e512ef-879d-453e-a752-c46789fe94eb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448482 Nov 21 13:52:26.506323 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-353f5ca9-7646-4a35-b608-fb671e0ff829 req-9afbb68b-c929-44ad-9113-ad920178604f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:26.507828 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-353f5ca9-7646-4a35-b608-fb671e0ff829 req-9afbb68b-c929-44ad-9113-ad920178604f tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0533350 Nov 21 13:52:26.555252 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-353f5ca9-7646-4a35-b608-fb671e0ff829 req-95d2c829-9c93-4014-ab9e-e684d42b805c tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409904 Nov 21 13:52:26.857265 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-eb0e143d-5bfc-4d4d-ae10-49e987d8fef8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:26.858626 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-eb0e143d-5bfc-4d4d-ae10-49e987d8fef8 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=a7f1c544-97e5-450d-9032-daf1d5a3a2a3 HTTP/1.1" status: 200 len: 858 time: 0.1463511 Nov 21 13:52:26.859828 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-42caf40c-10e7-4f85-95bc-453da30830b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:26.861100 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-42caf40c-10e7-4f85-95bc-453da30830b4 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=a7f1c544-97e5-450d-9032-daf1d5a3a2a3 HTTP/1.1" status: 200 len: 858 time: 0.1401114 Nov 21 13:52:26.863657 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-a553359c-f5ce-4635-9d77-06fa97e5b662 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:26.864989 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-a553359c-f5ce-4635-9d77-06fa97e5b662 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=c4887ea6-9c0e-4a7b-bd51-d70b335ceb92 HTTP/1.1" status: 200 len: 856 time: 0.1449945 Nov 21 13:52:26.879761 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62838225-0d7d-4511-905b-40ff9bbf550e req-5daa1f5a-df50-4bb8-95dc-3dad2afd61dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:26.881120 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-62838225-0d7d-4511-905b-40ff9bbf550e req-5daa1f5a-df50-4bb8-95dc-3dad2afd61dc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0939305 Nov 21 13:52:26.942557 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-2fd1d496-4db4-4709-8e31-e790a0a576fb service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0576801 Nov 21 13:52:26.944190 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-50b7775e-8d63-47bb-ab80-b441334f7336 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0513973 Nov 21 13:52:27.112590 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-7e4e7231-0d83-4e3f-9741-3b0c12a8e54b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:27.114015 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-7e4e7231-0d83-4e3f-9741-3b0c12a8e54b service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=24c864ef-5c5a-4df8-8968-78a7fe30b188&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.2202873 Nov 21 13:52:27.117329 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-62838225-0d7d-4511-905b-40ff9bbf550e req-cb52bf06-78c3-41b1-b3bf-eab79637aa4d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2254889 Nov 21 13:52:27.210125 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-2e58f6ce-a8a7-44a8-ad6f-c7230b3509a1 service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2451270 Nov 21 13:52:27.215077 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-a2734eb2-96ce-488f-8eab-9fe603686952 service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2512400 Nov 21 13:52:27.249172 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-d38d638f-343a-4294-a1ad-f0c4cbba9cf6 service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1238449 Nov 21 13:52:27.250750 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b556add7-eb8a-4a65-9826-2afe0efaff7d req-bf8978ed-aff3-44f3-b21c-2eae26e3a5cd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:27.252258 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b556add7-eb8a-4a65-9826-2afe0efaff7d req-bf8978ed-aff3-44f3-b21c-2eae26e3a5cd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 944 time: 0.0515282 Nov 21 13:52:27.300703 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b556add7-eb8a-4a65-9826-2afe0efaff7d req-6bc6ec2a-abb1-4de7-9d9a-3c5862e381ac tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422082 Nov 21 13:52:27.586889 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91596c9c-5568-4b11-bc39-c9d2e5f31994 req-b4d7732d-f22a-4934-88cf-8d0057ef22dd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:27.588579 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-91596c9c-5568-4b11-bc39-c9d2e5f31994 req-b4d7732d-f22a-4934-88cf-8d0057ef22dd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 943 time: 0.0614030 Nov 21 13:52:27.638537 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-91596c9c-5568-4b11-bc39-c9d2e5f31994 req-ba4a4020-5205-4be4-a894-325d0b7530c0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421457 Nov 21 13:52:27.676161 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72be7545-4161-488f-899e-2ab3bc93bd99 req-2caae8fc-e601-4a0e-8e73-d378dc7eaf9c tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:27.677624 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-72be7545-4161-488f-899e-2ab3bc93bd99 req-2caae8fc-e601-4a0e-8e73-d378dc7eaf9c tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0539637 Nov 21 13:52:27.727731 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-72be7545-4161-488f-899e-2ab3bc93bd99 req-c8388715-1290-4b09-95ca-d9ab4e1cb4a3 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440252 Nov 21 13:52:28.232536 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e1108a9-b1f4-469c-ba05-f8683ebfae5a req-ad912db3-85e3-4e6e-b688-546d36452b9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:28.233945 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2e1108a9-b1f4-469c-ba05-f8683ebfae5a req-ad912db3-85e3-4e6e-b688-546d36452b9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0460413 Nov 21 13:52:28.278808 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2e1108a9-b1f4-469c-ba05-f8683ebfae5a req-dfef8ef3-b206-4548-9c8a-ced87715146b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384214 Nov 21 13:52:28.412482 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87a362fe-0c23-4808-bd11-ad339bfe523a req-10a232eb-4f78-455f-a9cd-ea9318644a07 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:28.413912 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-87a362fe-0c23-4808-bd11-ad339bfe523a req-10a232eb-4f78-455f-a9cd-ea9318644a07 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 944 time: 0.0479119 Nov 21 13:52:28.458874 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-87a362fe-0c23-4808-bd11-ad339bfe523a req-eeada41a-72e4-4e54-8850-c669b3361817 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391865 Nov 21 13:52:28.751377 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34077333-90c3-492c-8c92-7f7e1e0d64ed req-ff3a3a94-7f14-4501-bc6c-b4468511f8a7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:28.753210 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-34077333-90c3-492c-8c92-7f7e1e0d64ed req-ff3a3a94-7f14-4501-bc6c-b4468511f8a7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 943 time: 0.0507739 Nov 21 13:52:28.849532 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9ffc91d-1a18-415d-91f3-d6030877b339 req-eae47c97-7fb3-4593-b043-00d29002e1de tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:28.851012 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e9ffc91d-1a18-415d-91f3-d6030877b339 req-eae47c97-7fb3-4593-b043-00d29002e1de tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0512958 Nov 21 13:52:28.900317 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e9ffc91d-1a18-415d-91f3-d6030877b339 req-73237d93-ed68-47c3-b533-df177399ed22 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430930 Nov 21 13:52:28.980128 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-34077333-90c3-492c-8c92-7f7e1e0d64ed req-0bdaf306-cca0-4e8e-9bb8-e30e7b7b02d5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2205265 Nov 21 13:52:29.412614 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2172f108-b384-4cce-b378-8a2e3cf875cc req-e94b790a-e40a-4663-8d59-259ed34c242c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:29.414060 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2172f108-b384-4cce-b378-8a2e3cf875cc req-e94b790a-e40a-4663-8d59-259ed34c242c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0526652 Nov 21 13:52:29.459458 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2172f108-b384-4cce-b378-8a2e3cf875cc req-3e90e009-7634-4623-9319-f5e5cd69a6fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395367 Nov 21 13:52:29.569811 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e841ab-5c1c-46fb-8113-6291c8083fd8 req-de72ff9d-3025-4970-8419-bb97f7e77d9d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:29.571190 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c8e841ab-5c1c-46fb-8113-6291c8083fd8 req-de72ff9d-3025-4970-8419-bb97f7e77d9d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 944 time: 0.0478675 Nov 21 13:52:29.616354 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c8e841ab-5c1c-46fb-8113-6291c8083fd8 req-8d1e1719-c706-4c77-b421-f714281b2b2b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392745 Nov 21 13:52:30.011883 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-283c49b1-2b7a-4542-a954-8267dd04d1ac req-25b388c4-c173-4b26-9e63-5068caa96207 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:30.013392 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-283c49b1-2b7a-4542-a954-8267dd04d1ac req-25b388c4-c173-4b26-9e63-5068caa96207 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0480268 Nov 21 13:52:30.059557 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-283c49b1-2b7a-4542-a954-8267dd04d1ac req-424478cc-0370-4156-a488-c4649c4eed7b tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402315 Nov 21 13:52:30.090769 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55670e98-a73a-4754-922f-1ac38e6cd41f req-26f156e6-4453-402b-bead-ea15b83b4b71 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:30.092275 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-55670e98-a73a-4754-922f-1ac38e6cd41f req-26f156e6-4453-402b-bead-ea15b83b4b71 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 943 time: 0.0479009 Nov 21 13:52:30.141210 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-55670e98-a73a-4754-922f-1ac38e6cd41f req-c4fa1943-e556-4fbb-90b0-8fb0eab46e37 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429568 Nov 21 13:52:30.159161 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c89401bd-c158-4b10-8800-2c89c0e1613c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:30.374037 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec9a05eb-58fd-4d8e-b4d0-46934823a244 req-1bb5d239-5804-4195-a6db-c909ecf4fa29 service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2132382 Nov 21 13:52:30.390700 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1b99b263-7f2e-43d4-98d2-b5cac0dc552b req-c9ac1691-b78d-4d6d-97c2-af36a2274b80 service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2113473 Nov 21 13:52:30.392656 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-da676032-414c-4464-a4fd-70ce5e69bd87 req-c2683d7f-93d7-4a07-bffb-dbf4d21260d8 service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2143519 Nov 21 13:52:30.578307 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1851583-5675-4744-99d1-82fe2c16d278 req-e45852fe-307b-451a-90a0-de336e40d363 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:30.579855 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d1851583-5675-4744-99d1-82fe2c16d278 req-e45852fe-307b-451a-90a0-de336e40d363 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0491495 Nov 21 13:52:30.630548 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d1851583-5675-4744-99d1-82fe2c16d278 req-4aa71aa2-7173-409c-ba64-82520b8c793d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447004 Nov 21 13:52:30.742395 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60991bff-e319-44ab-8b4d-ae9dc63c7200 req-d12ca958-07c5-49f2-9b97-54cea542ffdd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:30.744353 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:52:30.744497 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-60991bff-e319-44ab-8b4d-ae9dc63c7200 req-d12ca958-07c5-49f2-9b97-54cea542ffdd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 944 time: 0.0527766 Nov 21 13:52:30.803876 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-60991bff-e319-44ab-8b4d-ae9dc63c7200 req-d152ff57-3786-422c-aa75-9880ce1e5994 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0521820 Nov 21 13:52:30.825961 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device e97fd0d3-216a-4615-aa4a-a98857cba123 up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:52:30.855184 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5,segment=NetworkSegment(87188554-865b-4f60-ac47-7f9dc768573f),segment_id=87188554-865b-4f60-ac47-7f9dc768573f)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:30.886255 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': 'e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5', 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a', 'port_id': 'e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5', 'mac_address': 'fa:16:3e:1a:9d:e0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 521, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a7f1c544-97e5-450d-9032-daf1d5a3a2a3', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:52:30.942171 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:30.962666 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:52:30.968772 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port e97fd0d3-216a-4615-aa4a-a98857cba123 completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:52:30.978421 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port e97fd0d3-216a-4615-aa4a-a98857cba123 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:52:30.978758 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:31.006012 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5,segment=NetworkSegment(87188554-865b-4f60-ac47-7f9dc768573f),segment_id=87188554-865b-4f60-ac47-7f9dc768573f)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:31.014424 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:31.203062 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b2aa003-f763-4ac4-a7f0-bbe3fc5ab524 req-7f872e4a-ae26-4405-8163-3437e3e50dba tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:31.204612 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-9b2aa003-f763-4ac4-a7f0-bbe3fc5ab524 req-7f872e4a-ae26-4405-8163-3437e3e50dba tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0688441 Nov 21 13:52:31.225250 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:31.248000 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:31.276979 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1aa7ec26-0d3e-4d40-87d2-45e63ed435eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e97fd0d3-216a-4615-aa4a-a98857cba123'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:52:31.279840 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-36ba109e-c35a-445f-9f9e-a91855264580" -d '{"events": [{"server_uuid": "1aa7ec26-0d3e-4d40-87d2-45e63ed435eb", "name": "network-vif-plugged", "status": "completed", "tag": "e97fd0d3-216a-4615-aa4a-a98857cba123"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:52:31.302760 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port e97fd0d3-216a-4615-aa4a-a98857cba123, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=e97fd0d3-216a-4615-aa4a-a98857cba123,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:31.312528 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:31.324183 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:52:31.330341 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd64424-540f-4079-88b4-9aa459a2e17c req-676ddbe2-6a21-4402-ae17-d5cd07bb88a8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:31.338127 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-9b2aa003-f763-4ac4-a7f0-bbe3fc5ab524 req-ff541126-0629-4690-a787-e0e0c32ea352 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1244538 Nov 21 13:52:31.339972 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ecd64424-540f-4079-88b4-9aa459a2e17c req-676ddbe2-6a21-4402-ae17-d5cd07bb88a8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 943 time: 0.0907638 Nov 21 13:52:31.420246 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=e97fd0d3-216a-4615-aa4a-a98857cba123,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:31.450394 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ecd64424-540f-4079-88b4-9aa459a2e17c req-f5a168e3-1661-4ab2-ade1-b742b4817f3a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1093295 Nov 21 13:52:31.473212 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:52:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b28d263d-6cba-4420-8ae0-11a5d2da61e3 x-openstack-request-id: req-b28d263d-6cba-4420-8ae0-11a5d2da61e3 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:52:31.473958 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1aa7ec26-0d3e-4d40-87d2-45e63ed435eb", "name": "network-vif-plugged", "status": "completed", "tag": "e97fd0d3-216a-4615-aa4a-a98857cba123", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:52:31.474436 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-b28d263d-6cba-4420-8ae0-11a5d2da61e3 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:52:31.475349 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1aa7ec26-0d3e-4d40-87d2-45e63ed435eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e97fd0d3-216a-4615-aa4a-a98857cba123', 'code': 200} Nov 21 13:52:31.712135 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aef9be1-4d9d-4e65-8f98-662c02f83778 req-de9fcfba-e85e-489c-8bd2-fffdaf3a7180 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:31.714245 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2aef9be1-4d9d-4e65-8f98-662c02f83778 req-de9fcfba-e85e-489c-8bd2-fffdaf3a7180 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 1098 time: 0.1016994 Nov 21 13:52:31.814140 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2aef9be1-4d9d-4e65-8f98-662c02f83778 req-4eb7dd73-303d-472b-90dd-74ea4cc9854a service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0916553 Nov 21 13:52:31.820437 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef5665f-6a9c-4799-93d1-0a78ea1079c6 req-21cee8aa-5484-4d53-8cc4-fe4734e01c56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:31.828642 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0ef5665f-6a9c-4799-93d1-0a78ea1079c6 req-21cee8aa-5484-4d53-8cc4-fe4734e01c56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0615592 Nov 21 13:52:31.882152 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0ef5665f-6a9c-4799-93d1-0a78ea1079c6 req-4d99b70b-d489-4ae4-9c2e-e57307c93f37 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0525565 Nov 21 13:52:31.962231 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dd0a9e0-7a79-4eac-8571-9af4d8006222 req-eb961999-fb64-4d00-9b27-05ac24f6a255 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:31.963973 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2dd0a9e0-7a79-4eac-8571-9af4d8006222 req-eb961999-fb64-4d00-9b27-05ac24f6a255 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0575778 Nov 21 13:52:32.027420 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2dd0a9e0-7a79-4eac-8571-9af4d8006222 req-b1ba57d4-a9bb-4b37-ac21-63049ed70572 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0544066 Nov 21 13:52:32.551565 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8e6e6c78-d32e-4772-a4e0-6c8f2be3a474 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:32.591547 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a689a25b-8eb3-4b85-a734-49d7a66fd18a req-505b9090-0a91-4814-b7e9-9d73aa2184a6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:32.593114 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a689a25b-8eb3-4b85-a734-49d7a66fd18a req-505b9090-0a91-4814-b7e9-9d73aa2184a6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 943 time: 0.0577204 Nov 21 13:52:32.639771 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a689a25b-8eb3-4b85-a734-49d7a66fd18a req-15f34a97-5312-4938-b43b-fcb00049c346 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405865 Nov 21 13:52:32.997823 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19ed7cc-3872-4ece-85aa-dd26996da106 req-9821c725-7d6b-46cf-9758-7b8c357bd566 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:32.999266 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a19ed7cc-3872-4ece-85aa-dd26996da106 req-9821c725-7d6b-46cf-9758-7b8c357bd566 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0472403 Nov 21 13:52:33.045001 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a19ed7cc-3872-4ece-85aa-dd26996da106 req-32f85cfa-61d0-4d61-b2fa-136192445ad9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389037 Nov 21 13:52:33.150421 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbfe1ae3-5db6-4135-9745-071aee9de13f req-f1d15f0f-1c64-4ee6-bb0d-26e275c2ed86 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:33.151910 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-fbfe1ae3-5db6-4135-9745-071aee9de13f req-f1d15f0f-1c64-4ee6-bb0d-26e275c2ed86 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0510862 Nov 21 13:52:33.200588 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-fbfe1ae3-5db6-4135-9745-071aee9de13f req-f5bdfbf7-d198-471a-a9df-e35ee6241e98 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428751 Nov 21 13:52:33.366521 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device dcf844c6-0002-4d63-9e63-4bf56191c807 details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:52:33.462040 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port dcf844c6-0002-4d63-9e63-4bf56191c807, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=dcf844c6-0002-4d63-9e63-4bf56191c807,segment=NetworkSegment(87188554-865b-4f60-ac47-7f9dc768573f),segment_id=87188554-865b-4f60-ac47-7f9dc768573f)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:33.473590 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': 'dcf844c6-0002-4d63-9e63-4bf56191c807', 'network_id': '63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a', 'port_id': 'dcf844c6-0002-4d63-9e63-4bf56191c807', 'mac_address': 'fa:16:3e:58:e2:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 521, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a7f1c544-97e5-450d-9032-daf1d5a3a2a3', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:52:33.509339 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:33.521932 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dcf844c6-0002-4d63-9e63-4bf56191c807 {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:52:33.541687 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port dcf844c6-0002-4d63-9e63-4bf56191c807, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=dcf844c6-0002-4d63-9e63-4bf56191c807,segment=NetworkSegment(87188554-865b-4f60-ac47-7f9dc768573f),segment_id=87188554-865b-4f60-ac47-7f9dc768573f)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:33.545207 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:33.545829 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 627d561d-d2ff-449e-a99f-9e5e3fd874ba details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:52:33.636722 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=dcf844c6-0002-4d63-9e63-4bf56191c807,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:33.677574 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:33.691621 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'port_id': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'mac_address': 'fa:16:3e:1c:94:81', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 524, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:52:33.727694 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:33.740274 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 627d561d-d2ff-449e-a99f-9e5e3fd874ba {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:52:33.749752 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9028b3c-43a0-400e-9d6c-7885e4a1864c req-71628c9b-859b-453b-bb25-05ff9e7479a3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:33.751213 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b9028b3c-43a0-400e-9d6c-7885e4a1864c req-71628c9b-859b-453b-bb25-05ff9e7479a3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 944 time: 0.0469089 Nov 21 13:52:33.763369 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:33.767354 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:33.799351 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b9028b3c-43a0-400e-9d6c-7885e4a1864c req-70fd3c55-2a24-41ed-80a5-d6f29f8c3f74 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415952 Nov 21 13:52:33.814389 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=627d561d-d2ff-449e-a99f-9e5e3fd874ba,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:33.848068 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:34.160052 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d699ec79-f162-4533-a7a7-8e1db1bd70d9 req-307ce2e8-ed8c-45f3-bb4c-844c181c1d75 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:34.161496 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d699ec79-f162-4533-a7a7-8e1db1bd70d9 req-307ce2e8-ed8c-45f3-bb4c-844c181c1d75 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 945 time: 0.0473955 Nov 21 13:52:34.210048 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d699ec79-f162-4533-a7a7-8e1db1bd70d9 req-36da05e9-e925-4b2f-9177-2e28d7e5c541 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428510 Nov 21 13:52:34.233576 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:52:34.289060 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:52:34.294171 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:52:34.294531 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:34.334146 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b706b615-fc7c-4df4-a2cc-def01f2fece0 req-1c567a4b-4dca-4615-9a66-94d0fabd57a8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:34.335644 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b706b615-fc7c-4df4-a2cc-def01f2fece0 req-1c567a4b-4dca-4615-9a66-94d0fabd57a8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0542135 Nov 21 13:52:34.373920 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:34.383242 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b706b615-fc7c-4df4-a2cc-def01f2fece0 req-535a6732-f1d3-49c7-969c-3e34733c5249 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409718 Nov 21 13:52:34.397446 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2d1c9d3d-f088-4d2f-b2bc-e26543509aae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:52:34.399658 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-752c6a73-f2bf-4d36-a120-731413b8328e" -d '{"events": [{"server_uuid": "2d1c9d3d-f088-4d2f-b2bc-e26543509aae", "name": "network-vif-plugged", "status": "completed", "tag": "e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:52:34.412618 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5,segment=NetworkSegment(87188554-865b-4f60-ac47-7f9dc768573f),segment_id=87188554-865b-4f60-ac47-7f9dc768573f)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:34.416306 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:34.439492 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:52:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb7529f8-7374-40c7-8a38-413029b52259 x-openstack-request-id: req-cb7529f8-7374-40c7-8a38-413029b52259 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:52:34.439818 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2d1c9d3d-f088-4d2f-b2bc-e26543509aae", "name": "network-vif-plugged", "status": "completed", "tag": "e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:52:34.440080 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-cb7529f8-7374-40c7-8a38-413029b52259 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:52:34.440513 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2d1c9d3d-f088-4d2f-b2bc-e26543509aae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5', 'code': 200} Nov 21 13:52:34.464758 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:34.912165 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508ff244-8f4e-4cc3-99ce-bb7431b6cee0 req-3e19e17c-582c-4399-839b-b46e1c3053ec tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:34.913620 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-508ff244-8f4e-4cc3-99ce-bb7431b6cee0 req-3e19e17c-582c-4399-839b-b46e1c3053ec tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 944 time: 0.0473523 Nov 21 13:52:34.959258 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-508ff244-8f4e-4cc3-99ce-bb7431b6cee0 req-0afe393f-e786-4d59-9e8b-342fab8d9d5d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398438 Nov 21 13:52:35.036340 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:35.358895 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e50db2a4-75ac-4334-b0e3-09965c44c1b6 req-4dd8dcde-5723-42c3-94d3-fb63f3e1879e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:35.360557 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e50db2a4-75ac-4334-b0e3-09965c44c1b6 req-4dd8dcde-5723-42c3-94d3-fb63f3e1879e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 945 time: 0.0681069 Nov 21 13:52:35.414272 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e50db2a4-75ac-4334-b0e3-09965c44c1b6 req-3f69f3f7-fa70-4b51-948a-61e804fad07f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469151 Nov 21 13:52:35.439202 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a8860c6-9de2-450e-89b7-8c015a70fc40 req-d1c8c145-a179-4a1d-96bd-8bd721b51d3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:35.439202 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5a8860c6-9de2-450e-89b7-8c015a70fc40 req-d1c8c145-a179-4a1d-96bd-8bd721b51d3d service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 1098 time: 0.0418046 Nov 21 13:52:35.507870 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5a8860c6-9de2-450e-89b7-8c015a70fc40 req-90ccf4b4-96dd-41cf-a546-14f90c5a721b service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599518 Nov 21 13:52:35.533178 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5207074f-cd83-4b01-aa17-1ac4153dccb9 req-03cafb71-55f3-40d4-b979-97c85e7774c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:35.535504 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5207074f-cd83-4b01-aa17-1ac4153dccb9 req-03cafb71-55f3-40d4-b979-97c85e7774c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0544744 Nov 21 13:52:35.562452 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['627d561d-d2ff-449e-a99f-9e5e3fd874ba'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:52:35.568439 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['dcf844c6-0002-4d63-9e63-4bf56191c807'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:52:35.586452 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5207074f-cd83-4b01-aa17-1ac4153dccb9 req-d7bad9c2-8234-43f5-893e-a1f5751ab396 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446494 Nov 21 13:52:35.831654 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:36.079346 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-725da3fe-7d9f-485e-87ba-dd1ec82d7a58 req-d232a9bc-458e-470a-a32d-a0e875effcd5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:36.080839 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-725da3fe-7d9f-485e-87ba-dd1ec82d7a58 req-d232a9bc-458e-470a-a32d-a0e875effcd5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 944 time: 0.0492146 Nov 21 13:52:36.131255 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-725da3fe-7d9f-485e-87ba-dd1ec82d7a58 req-7dca6678-9fb6-418b-ad78-9a425d1cccd7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429125 Nov 21 13:52:36.546762 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c9bdc09-b290-44a0-9a07-39fc14ce6013 req-a78b3bc5-a6d9-47a7-b7a9-124f24533aad tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:36.548859 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7c9bdc09-b290-44a0-9a07-39fc14ce6013 req-a78b3bc5-a6d9-47a7-b7a9-124f24533aad tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 945 time: 0.0583208 Nov 21 13:52:36.612641 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7c9bdc09-b290-44a0-9a07-39fc14ce6013 req-d9b8b44a-f09c-4bca-a6b7-c0632e647fcd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0572865 Nov 21 13:52:36.736388 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50162) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:36.757518 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b279b90d-2a64-4047-867a-b2864a2bccce req-bf4f60e8-55a3-4c65-8413-47e0e49deddf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:36.764550 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b279b90d-2a64-4047-867a-b2864a2bccce req-bf4f60e8-55a3-4c65-8413-47e0e49deddf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0832281 Nov 21 13:52:36.825462 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b279b90d-2a64-4047-867a-b2864a2bccce req-1650eb9b-797e-43ed-af56-d3f1b355d026 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0592217 Nov 21 13:52:36.891496 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-aa25f25d-fb82-42dd-9a74-2f36d79bb2a5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:36.993282 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-aa25f25d-fb82-42dd-9a74-2f36d79bb2a5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.005065 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-aa25f25d-fb82-42dd-9a74-2f36d79bb2a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.049041 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-aa25f25d-fb82-42dd-9a74-2f36d79bb2a5 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=3702478164694d0081684bea7ffc5192&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3116169 Nov 21 13:52:37.052110 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa25f25d-fb82-42dd-9a74-2f36d79bb2a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61b01fc2-fe64-4d57-8fc7-822e6ae13019,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:37.052565 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b7f6e3-7c49-418e-8100-26b28b50187f req-39b121f6-bfd6-43ef-bc3b-518d198d3ebd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:37.054124 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-33b7f6e3-7c49-418e-8100-26b28b50187f req-39b121f6-bfd6-43ef-bc3b-518d198d3ebd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0570683 Nov 21 13:52:37.054605 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 50180) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:37.076713 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50182) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:37.081544 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-d2099c04-3131-48ab-817a-a32fcfb4e0eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Request body: {'floatingip': {'port_id': 'e97fd0d3-216a-4615-aa4a-a98857cba123'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:52:37.110535 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-121b2301-53b4-431c-bc71-c345ee58c491 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.132997 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-121b2301-53b4-431c-bc71-c345ee58c491 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.153260 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d2099c04-3131-48ab-817a-a32fcfb4e0eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.178425 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 50188) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:37.194873 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-121b2301-53b4-431c-bc71-c345ee58c491 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.197528 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-121b2301-53b4-431c-bc71-c345ee58c491 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.198791 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-121b2301-53b4-431c-bc71-c345ee58c491 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/61b01fc2-fe64-4d57-8fc7-822e6ae13019 HTTP/1.1" status: 204 len: 168 time: 0.1432741 Nov 21 13:52:37.218717 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-121b2301-53b4-431c-bc71-c345ee58c491 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61b01fc2-fe64-4d57-8fc7-822e6ae13019,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:37.257816 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device dcf844c6-0002-4d63-9e63-4bf56191c807 up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:52:37.323681 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0225ae80-b3bd-44ea-83b0-c3c20948d5b0 req-8bc1a6ee-0290-46dd-b4e0-fdcabe016f91 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:37.325245 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0225ae80-b3bd-44ea-83b0-c3c20948d5b0 req-8bc1a6ee-0290-46dd-b4e0-fdcabe016f91 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 944 time: 0.0951960 Nov 21 13:52:37.330299 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port dcf844c6-0002-4d63-9e63-4bf56191c807 completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:52:37.335018 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port dcf844c6-0002-4d63-9e63-4bf56191c807 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:52:37.335753 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.451523 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.479297 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0225ae80-b3bd-44ea-83b0-c3c20948d5b0 req-376537d2-1d0e-4d08-96e6-54a959556b97 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1426461 Nov 21 13:52:37.493437 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e6f04799-b287-41b6-9756-b259d5eeddeb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dcf844c6-0002-4d63-9e63-4bf56191c807'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:52:37.498321 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-001eab61-1113-4f9b-bef8-58afb51ecacd" -d '{"events": [{"server_uuid": "e6f04799-b287-41b6-9756-b259d5eeddeb", "name": "network-vif-plugged", "status": "completed", "tag": "dcf844c6-0002-4d63-9e63-4bf56191c807"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:52:37.517978 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port dcf844c6-0002-4d63-9e63-4bf56191c807, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=dcf844c6-0002-4d63-9e63-4bf56191c807,segment=NetworkSegment(87188554-865b-4f60-ac47-7f9dc768573f),segment_id=87188554-865b-4f60-ac47-7f9dc768573f)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:37.526604 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.527401 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 627d561d-d2ff-449e-a99f-9e5e3fd874ba up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:52:37.553679 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.582126 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:52:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f82d9211-80b0-4385-90ae-b111d4cf67a4 x-openstack-request-id: req-f82d9211-80b0-4385-90ae-b111d4cf67a4 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:52:37.582729 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e6f04799-b287-41b6-9756-b259d5eeddeb", "name": "network-vif-plugged", "status": "completed", "tag": "dcf844c6-0002-4d63-9e63-4bf56191c807", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:52:37.583164 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-f82d9211-80b0-4385-90ae-b111d4cf67a4 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:52:37.583596 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e6f04799-b287-41b6-9756-b259d5eeddeb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dcf844c6-0002-4d63-9e63-4bf56191c807', 'code': 200} Nov 21 13:52:37.616980 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=dcf844c6-0002-4d63-9e63-4bf56191c807,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:37.644126 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port 627d561d-d2ff-449e-a99f-9e5e3fd874ba completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:52:37.671000 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 627d561d-d2ff-449e-a99f-9e5e3fd874ba triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:52:37.673725 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.792134 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.799052 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.825110 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.841325 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=028292ddb9c3439585889a113aac9778&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6616092 Nov 21 13:52:37.842558 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62ccc94d-0d15-4e8a-b9a8-f3471fc5336f,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:37.846190 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 50222) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:37.859024 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:37.859705 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:37.860278 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:37.861191 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:37.861687 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:37.862178 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:37.863151 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:37.863638 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:37.864163 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:37.864650 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:37.864989 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:37.865320 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2c1a220-6696-4442-9e6e-12533a86d90d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:37.907352 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:37.916990 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.927107 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cdb502f1-2ef9-4c4a-a060-5d67fa382086 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.954971 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cdb502f1-2ef9-4c4a-a060-5d67fa382086 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:37.979464 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=627d561d-d2ff-449e-a99f-9e5e3fd874ba,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:37.997076 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6eaab44-4b9e-40b4-b4b4-4221a13c0d98 req-4984b5b1-3e1d-4df0-b95f-f76b50d1b1d4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:37.998960 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d6eaab44-4b9e-40b4-b4b4-4221a13c0d98 req-4984b5b1-3e1d-4df0-b95f-f76b50d1b1d4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 945 time: 0.2635002 Nov 21 13:52:38.012026 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cdb502f1-2ef9-4c4a-a060-5d67fa382086 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:38.014993 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cdb502f1-2ef9-4c4a-a060-5d67fa382086 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:38.016262 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-cdb502f1-2ef9-4c4a-a060-5d67fa382086 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/62ccc94d-0d15-4e8a-b9a8-f3471fc5336f HTTP/1.1" status: 204 len: 168 time: 0.1688325 Nov 21 13:52:38.016510 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6df780a7-c927-4748-a4e4-1c1ed16dd7ef req-a07fb7d9-b518-4db4-a693-a032408fe27e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:38.017936 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6df780a7-c927-4748-a4e4-1c1ed16dd7ef req-a07fb7d9-b518-4db4-a693-a032408fe27e service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 1098 time: 0.1896546 Nov 21 13:52:38.027068 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb502f1-2ef9-4c4a-a060-5d67fa382086 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62ccc94d-0d15-4e8a-b9a8-f3471fc5336f,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:38.148692 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d6eaab44-4b9e-40b4-b4b4-4221a13c0d98 req-c9802f43-fee0-4777-a029-4ff01e7b2794 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1349294 Nov 21 13:52:38.441163 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d2099c04-3131-48ab-817a-a32fcfb4e0eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:38.448942 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d2099c04-3131-48ab-817a-a32fcfb4e0eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:38.467609 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 50246) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:38.483929 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f6e47fdd-df72-4016-aa38-43bea3a89464 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:38.615051 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f6e47fdd-df72-4016-aa38-43bea3a89464 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:38.619147 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.l3_db [None req-d2099c04-3131-48ab-817a-a32fcfb4e0eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Floating IP 96099f02-959f-43d0-8c2b-b2b87c3426ff associated. External IP: 172.27.1.224, port: e97fd0d3-216a-4615-aa4a-a98857cba123. Nov 21 13:52:38.620891 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f6e47fdd-df72-4016-aa38-43bea3a89464 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:38.672538 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-f6e47fdd-df72-4016-aa38-43bea3a89464 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=954374253fe14dca9d2f0814a162f4bc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2015622 Nov 21 13:52:38.673157 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e47fdd-df72-4016-aa38-43bea3a89464 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=759aea8e-3086-415b-8ec6-0aff5c8e8a70,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:38.676826 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 50260) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:38.721009 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ff8e45-3abf-4f1b-b8ef-63ccf5f528cd req-6ecff00d-da5c-4ce6-a6c0-4319ff7375c7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:38.721009 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-15ff8e45-3abf-4f1b-b8ef-63ccf5f528cd req-6ecff00d-da5c-4ce6-a6c0-4319ff7375c7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.1468599 Nov 21 13:52:38.756437 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1088635e-edf2-4a20-b1b0-70717d8117da admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:38.800397 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1088635e-edf2-4a20-b1b0-70717d8117da admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:38.819952 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-15ff8e45-3abf-4f1b-b8ef-63ccf5f528cd req-699bcfa7-13a4-4354-bfad-2dfc2d625008 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0823822 Nov 21 13:52:38.872414 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1088635e-edf2-4a20-b1b0-70717d8117da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:38.875211 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1088635e-edf2-4a20-b1b0-70717d8117da admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:38.879175 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-1088635e-edf2-4a20-b1b0-70717d8117da admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/759aea8e-3086-415b-8ec6-0aff5c8e8a70 HTTP/1.1" status: 204 len: 168 time: 0.1963122 Nov 21 13:52:38.885583 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1088635e-edf2-4a20-b1b0-70717d8117da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=759aea8e-3086-415b-8ec6-0aff5c8e8a70,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:38.891798 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d2099c04-3131-48ab-817a-a32fcfb4e0eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Router 65d15860-a1d7-449d-b2d9-7210d0a1d10b has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:52:39.011413 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2099c04-3131-48ab-817a-a32fcfb4e0eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:52:39.016474 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d2099c04-3131-48ab-817a-a32fcfb4e0eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:39.027408 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c7eedfa-f9d2-446a-806c-95342899b4f5 None None] Sync routers for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:52:39.038803 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c7eedfa-f9d2-446a-806c-95342899b4f5 None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:52:39.039733 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-8c7eedfa-f9d2-446a-806c-95342899b4f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:52:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:39.046212 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-d2099c04-3131-48ab-817a-a32fcfb4e0eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "PUT /v2.0/floatingips/96099f02-959f-43d0-8c2b-b2b87c3426ff HTTP/1.1" status: 200 len: 991 time: 1.9682076 Nov 21 13:52:39.046824 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1aa7ec26-0d3e-4d40-87d2-45e63ed435eb', 'tag': 'e97fd0d3-216a-4615-aa4a-a98857cba123'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:52:39.049119 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e1eca60-728d-4bcd-9765-b08d1f6d817b" -d '{"events": [{"name": "network-changed", "server_uuid": "1aa7ec26-0d3e-4d40-87d2-45e63ed435eb", "tag": "e97fd0d3-216a-4615-aa4a-a98857cba123"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:52:39.119414 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:52:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ef857580-8adc-4b5a-984b-773162086f3b x-openstack-request-id: req-ef857580-8adc-4b5a-984b-773162086f3b {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:52:39.119717 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1aa7ec26-0d3e-4d40-87d2-45e63ed435eb", "tag": "e97fd0d3-216a-4615-aa4a-a98857cba123", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:52:39.120003 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-ef857580-8adc-4b5a-984b-773162086f3b {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:52:39.120401 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1aa7ec26-0d3e-4d40-87d2-45e63ed435eb', 'tag': 'e97fd0d3-216a-4615-aa4a-a98857cba123', 'status': 'completed', 'code': 200} Nov 21 13:52:39.146430 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6df780a7-c927-4748-a4e4-1c1ed16dd7ef req-14e0b8bf-83ca-44f7-ae88-44f4fe2fbb2b service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537448 Nov 21 13:52:39.194509 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-8c7eedfa-f9d2-446a-806c-95342899b4f5 None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:52:39.229360 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 50286) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:39.244997 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0d8d0db3-adf0-4a39-bfa1-e85342b1ccac admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:39.326706 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70fbb1dc-15df-4341-bd8f-652b52799ed4 req-15b33c18-5cbf-421b-98ea-73bf7d901970 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:39.328212 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-70fbb1dc-15df-4341-bd8f-652b52799ed4 req-15b33c18-5cbf-421b-98ea-73bf7d901970 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0808794 Nov 21 13:52:39.400433 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0d8d0db3-adf0-4a39-bfa1-e85342b1ccac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:39.404413 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-70fbb1dc-15df-4341-bd8f-652b52799ed4 req-78be429b-0ed3-4d4f-8db5-5f596f901665 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0645728 Nov 21 13:52:39.405405 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0d8d0db3-adf0-4a39-bfa1-e85342b1ccac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:39.448661 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50288) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:39.449088 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-0d8d0db3-adf0-4a39-bfa1-e85342b1ccac admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=dc1005070b1447c6986203e3dbfaca1a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2184680 Nov 21 13:52:39.449955 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d8d0db3-adf0-4a39-bfa1-e85342b1ccac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8bb7fead-c287-4dcf-acaf-5c2d8d4128a4,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:39.497669 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-8c7eedfa-f9d2-446a-806c-95342899b4f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': '96099f02-959f-43d0-8c2b-b2b87c3426ff', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'floating_ip_address': '172.27.1.224', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'port_id': 'e97fd0d3-216a-4615-aa4a-a98857cba123', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 116, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'mac_address': 'fa:16:3e:e6:7f:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1aa7ec26-0d3e-4d40-87d2-45e63ed435eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:52:00Z', 'updated_at': '2021-11-21T13:52:38Z', 'revision_number': 1, 'project_id': '389c281a19bb49e583633f57108f7f69', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 5, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:39.502747 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:39.525804 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:39.529206 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c7eedfa-f9d2-446a-806c-95342899b4f5 None None] Checking router: 65d15860-a1d7-449d-b2d9-7210d0a1d10b for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:52:39.538777 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c7eedfa-f9d2-446a-806c-95342899b4f5 None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:52:39.539697 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-8c7eedfa-f9d2-446a-806c-95342899b4f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:52:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:39.590422 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:52:39.593051 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-caf24a78-099a-4136-84cd-c9c879a298cd" -d '{"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-plugged", "status": "completed", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:52:39.598952 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:39.603083 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:39.605060 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/8bb7fead-c287-4dcf-acaf-5c2d8d4128a4 HTTP/1.1" status: 204 len: 168 time: 0.1550853 Nov 21 13:52:39.632074 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8bb7fead-c287-4dcf-acaf-5c2d8d4128a4,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:39.654557 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:39.654921 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:39.655280 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:39.656349 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:39.656708 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:39.657056 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:39.657465 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:39.657814 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:39.658157 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:39.658691 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:39.659145 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:39.659388 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a9561db-88e0-4a38-8efd-d5d433cff2b2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:52:39.662239 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:52:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d069d937-230a-4582-9d9c-387a8f60e124 x-openstack-request-id: req-d069d937-230a-4582-9d9c-387a8f60e124 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:52:39.662804 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-plugged", "status": "completed", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:52:39.663287 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-d069d937-230a-4582-9d9c-387a8f60e124 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:52:39.663687 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'code': 200} Nov 21 13:52:39.687750 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-8c7eedfa-f9d2-446a-806c-95342899b4f5 None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:52:39.924362 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-8c7eedfa-f9d2-446a-806c-95342899b4f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': '96099f02-959f-43d0-8c2b-b2b87c3426ff', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'floating_ip_address': '172.27.1.224', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'port_id': 'e97fd0d3-216a-4615-aa4a-a98857cba123', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 116, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'mac_address': 'fa:16:3e:e6:7f:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1aa7ec26-0d3e-4d40-87d2-45e63ed435eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:52:00Z', 'updated_at': '2021-11-21T13:52:38Z', 'revision_number': 1, 'project_id': '389c281a19bb49e583633f57108f7f69', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 5, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:39.952877 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10102bc5-1faa-4bc7-b8bd-3282b4461f7e req-2b31c5b5-3f09-486d-9697-15135ef93097 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:39.954352 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-10102bc5-1faa-4bc7-b8bd-3282b4461f7e req-2b31c5b5-3f09-486d-9697-15135ef93097 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0559242 Nov 21 13:52:39.954483 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c7eedfa-f9d2-446a-806c-95342899b4f5 None None] The sync data for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi is: [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': '96099f02-959f-43d0-8c2b-b2b87c3426ff', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'floating_ip_address': '172.27.1.224', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'port_id': 'e97fd0d3-216a-4615-aa4a-a98857cba123', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 116, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'mac_address': 'fa:16:3e:e6:7f:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1aa7ec26-0d3e-4d40-87d2-45e63ed435eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:52:00Z', 'updated_at': '2021-11-21T13:52:38Z', 'revision_number': 1, 'project_id': '389c281a19bb49e583633f57108f7f69', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 5, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:52:40.013407 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-10102bc5-1faa-4bc7-b8bd-3282b4461f7e req-cae1251c-0343-4f4b-8ed5-340305d893a7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512235 Nov 21 13:52:40.158417 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f164e4c-9def-49f0-90f7-a27183dbcb16 None None] New status for floating IP 96099f02-959f-43d0-8c2b-b2b87c3426ff: ACTIVE {{(pid=109042) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 13:52:40.526055 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e8f865f-327a-4940-8450-2eb646d11fab req-067d2b90-7a4b-477e-8112-90fc6c852aa0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:40.527500 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-6e8f865f-327a-4940-8450-2eb646d11fab req-067d2b90-7a4b-477e-8112-90fc6c852aa0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0463250 Nov 21 13:52:40.574398 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-6e8f865f-327a-4940-8450-2eb646d11fab req-2f961f54-5a29-4a14-8158-2fa45b791286 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411739 Nov 21 13:52:41.126494 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9bfda3-429a-42b6-9d95-a8f1e22d9ece req-5f4774ba-466f-486b-b9cc-71958b9b2216 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:41.129077 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-9c9bfda3-429a-42b6-9d95-a8f1e22d9ece req-5f4774ba-466f-486b-b9cc-71958b9b2216 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0509014 Nov 21 13:52:41.176811 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-9c9bfda3-429a-42b6-9d95-a8f1e22d9ece req-42ac63a4-9a0a-4ae4-bd5f-95158387b413 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412486 Nov 21 13:52:41.442758 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-78928f4d-ef17-4180-a880-82edb5e8b467 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:41.444204 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-78928f4d-ef17-4180-a880-82edb5e8b467 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=389c281a19bb49e583633f57108f7f69&device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 1098 time: 0.0461147 Nov 21 13:52:41.569057 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-dea42359-dd4f-413f-b2a5-3a33e90d714f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:41.570475 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-dea42359-dd4f-413f-b2a5-3a33e90d714f service neutron] 10.222.0.50 "GET /v2.0/networks?id=ea19090b-8034-4904-8b6c-1752befe0b5a HTTP/1.1" status: 200 len: 912 time: 0.1108356 Nov 21 13:52:41.582302 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9e8caca-f70d-46e9-9f47-14981f0e8947 req-630203ce-13c2-4b26-8259-5ccaf8d1c971 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:41.583624 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b9e8caca-f70d-46e9-9f47-14981f0e8947 req-630203ce-13c2-4b26-8259-5ccaf8d1c971 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 1099 time: 0.0493884 Nov 21 13:52:41.699681 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-5e519c9b-5a15-4c82-a22c-f98f226c53ab service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e97fd0d3-216a-4615-aa4a-a98857cba123 HTTP/1.1" status: 200 len: 1001 time: 0.1151068 Nov 21 13:52:41.701530 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91573a09-88d2-42c9-b30c-22286716bfa5 req-426da10d-49f8-4af0-b368-75ae0b156500 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:41.703097 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-91573a09-88d2-42c9-b30c-22286716bfa5 req-426da10d-49f8-4af0-b368-75ae0b156500 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0545683 Nov 21 13:52:41.705766 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b9e8caca-f70d-46e9-9f47-14981f0e8947 req-b0f280d5-d6a1-499b-a37b-fef0e73c00f2 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0845549 Nov 21 13:52:41.751013 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-91573a09-88d2-42c9-b30c-22286716bfa5 req-ced1e57e-4a93-4202-9041-0d119cfdfc44 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413632 Nov 21 13:52:41.755596 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-8cdf4225-72d2-4364-b73d-20c286d25106 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:41.757107 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-8cdf4225-72d2-4364-b73d-20c286d25106 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0 HTTP/1.1" status: 200 len: 850 time: 0.0465431 Nov 21 13:52:42.018641 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-caedcd84-4204-4d82-b989-f7c0ccccd02c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:42.020326 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-caedcd84-4204-4d82-b989-f7c0ccccd02c service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=ea19090b-8034-4904-8b6c-1752befe0b5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0526774 Nov 21 13:52:42.116303 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-504fda31-3ecf-40af-a5f3-bf057e731dc6 service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867929 Nov 21 13:52:42.204623 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1e1eca60-728d-4bcd-9765-b08d1f6d817b req-642d73ae-de4f-46d4-978d-72c2bc052022 service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0800471 Nov 21 13:52:42.293193 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5cf7d45-04b2-4f11-92e0-b96f802c2ae2 req-266c3e15-6b9b-44eb-a84d-62ec4570e040 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:42.294667 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e5cf7d45-04b2-4f11-92e0-b96f802c2ae2 req-266c3e15-6b9b-44eb-a84d-62ec4570e040 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0502398 Nov 21 13:52:42.345630 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e5cf7d45-04b2-4f11-92e0-b96f802c2ae2 req-22e2a2a5-f865-428e-8f3b-ba2c13fd299d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444920 Nov 21 13:52:42.876528 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74ab90b5-0364-4556-9f17-56717f10f1df req-b3391361-51f8-49bf-8c89-6605d1f63e74 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:42.878489 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-74ab90b5-0364-4556-9f17-56717f10f1df req-b3391361-51f8-49bf-8c89-6605d1f63e74 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0533764 Nov 21 13:52:42.932031 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-74ab90b5-0364-4556-9f17-56717f10f1df req-58afc38d-6010-4a86-86e4-1f285fef6268 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456653 Nov 21 13:52:43.457800 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffbe9de7-e701-487d-b1b5-4316c43a19f3 req-f98718d6-5978-49c6-a3f2-e033a8174a4c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:43.459232 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ffbe9de7-e701-487d-b1b5-4316c43a19f3 req-f98718d6-5978-49c6-a3f2-e033a8174a4c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0464387 Nov 21 13:52:43.505014 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ffbe9de7-e701-487d-b1b5-4316c43a19f3 req-9538bb1c-6c78-4041-9b1a-d3603b54c7fa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401027 Nov 21 13:52:44.061570 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12a69844-4367-445c-9eb6-8339200ec01f req-a347a34b-ee2e-4bbe-bca7-94e2c47008b3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:44.063016 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-12a69844-4367-445c-9eb6-8339200ec01f req-a347a34b-ee2e-4bbe-bca7-94e2c47008b3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0506072 Nov 21 13:52:44.109910 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-12a69844-4367-445c-9eb6-8339200ec01f req-9db22e5f-1676-49e1-8d1e-be73e3adc377 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410328 Nov 21 13:52:44.613175 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15cc39be-e08f-4323-a158-cc66f3c81ca8 req-5bcc5d97-c452-422a-a7e9-4a411aa647f1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:44.614516 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-15cc39be-e08f-4323-a158-cc66f3c81ca8 req-5bcc5d97-c452-422a-a7e9-4a411aa647f1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0457811 Nov 21 13:52:44.660115 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-15cc39be-e08f-4323-a158-cc66f3c81ca8 req-419f5fab-86eb-4073-8754-1bd11c45298f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398617 Nov 21 13:52:45.230594 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1c86dde-a326-4995-983f-537788897a07 req-f774d819-f2f5-41d5-bd5a-17c31b2904da tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:45.232110 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a1c86dde-a326-4995-983f-537788897a07 req-f774d819-f2f5-41d5-bd5a-17c31b2904da tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0505927 Nov 21 13:52:45.283320 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a1c86dde-a326-4995-983f-537788897a07 req-e5343248-469a-4018-baeb-4c5c68eea93c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446386 Nov 21 13:52:45.775328 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75696545-0746-422a-bc45-91c662a1a8b1 req-e9650b85-01f4-402c-a9d3-c610ded0b6f2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:45.776820 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-75696545-0746-422a-bc45-91c662a1a8b1 req-e9650b85-01f4-402c-a9d3-c610ded0b6f2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0488060 Nov 21 13:52:45.826919 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-75696545-0746-422a-bc45-91c662a1a8b1 req-b07e56d5-1224-4885-8ad4-6c67164b9c78 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440407 Nov 21 13:52:46.458847 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5d0b8a-ae80-45b8-a7fc-72711aa40e48 req-20e6e183-51cd-4dee-82c7-0eaa6eade675 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:46.462437 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3f5d0b8a-ae80-45b8-a7fc-72711aa40e48 req-20e6e183-51cd-4dee-82c7-0eaa6eade675 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0761843 Nov 21 13:52:46.540271 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3f5d0b8a-ae80-45b8-a7fc-72711aa40e48 req-99db1212-25b2-4820-8acc-a3b488142520 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0713849 Nov 21 13:52:46.552673 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50502) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:46.686319 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3323bd2d-ef73-4d20-bb46-a8bbb9be1ec2 req-313c51dc-5895-45e4-a042-e482a6eebea0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:46.688047 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3323bd2d-ef73-4d20-bb46-a8bbb9be1ec2 req-313c51dc-5895-45e4-a042-e482a6eebea0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0551968 Nov 21 13:52:46.698365 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 50514) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:46.701364 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3a3c5a9d-996e-44cf-9d74-75b2cb318e72 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:46.707923 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-d4d96373-f8d0-4596-b1f4-cd19145e03c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Request body: {'floatingip': {'port_id': '627d561d-d2ff-449e-a99f-9e5e3fd874ba'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:52:46.782779 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3a3c5a9d-996e-44cf-9d74-75b2cb318e72 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:46.788780 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3a3c5a9d-996e-44cf-9d74-75b2cb318e72 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:46.790313 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d4d96373-f8d0-4596-b1f4-cd19145e03c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:46.820276 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50518) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:46.833467 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a3c5a9d-996e-44cf-9d74-75b2cb318e72 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60d5e9f3-8f00-4d48-b505-6359788cdbb2,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:46.838345 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-3a3c5a9d-996e-44cf-9d74-75b2cb318e72 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=1025db2af0294295b648af787428a88f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2845798 Nov 21 13:52:46.841382 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50522) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:46.923300 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fb73bdf3-664c-450c-8aec-c5f5c35a8267 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:46.959457 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fb73bdf3-664c-450c-8aec-c5f5c35a8267 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:46.967128 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d692f1ef-a58d-4581-870c-6e19ff1087de admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.038951 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83786fd9-b8fa-414e-b91a-b36efebea8c2 req-ca1dc6c4-cc5a-4568-8fe9-9280a95c3c43 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:47.040605 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-83786fd9-b8fa-414e-b91a-b36efebea8c2 req-ca1dc6c4-cc5a-4568-8fe9-9280a95c3c43 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.1282654 Nov 21 13:52:47.043385 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fb73bdf3-664c-450c-8aec-c5f5c35a8267 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.046540 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fb73bdf3-664c-450c-8aec-c5f5c35a8267 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.047661 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-fb73bdf3-664c-450c-8aec-c5f5c35a8267 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/60d5e9f3-8f00-4d48-b505-6359788cdbb2 HTTP/1.1" status: 204 len: 168 time: 0.2050099 Nov 21 13:52:47.087798 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d692f1ef-a58d-4581-870c-6e19ff1087de admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.089358 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb73bdf3-664c-450c-8aec-c5f5c35a8267 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60d5e9f3-8f00-4d48-b505-6359788cdbb2,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:47.109868 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d692f1ef-a58d-4581-870c-6e19ff1087de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.167493 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-d692f1ef-a58d-4581-870c-6e19ff1087de admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=6fc55042f1224f2389e49776d5318434&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3436670 Nov 21 13:52:47.168448 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50530) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:47.169202 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d692f1ef-a58d-4581-870c-6e19ff1087de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c4fb98e9-5fe1-4ede-9cdc-862abecc7f72,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:47.249924 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-610c1b90-42ef-424a-9973-9b19d00da73b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.279543 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-610c1b90-42ef-424a-9973-9b19d00da73b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.308670 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-83786fd9-b8fa-414e-b91a-b36efebea8c2 req-7e196808-bdb6-4a64-8d5d-b6a683ea797d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2617750 Nov 21 13:52:47.361008 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-610c1b90-42ef-424a-9973-9b19d00da73b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.364950 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-610c1b90-42ef-424a-9973-9b19d00da73b admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.366556 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-610c1b90-42ef-424a-9973-9b19d00da73b admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/c4fb98e9-5fe1-4ede-9cdc-862abecc7f72 HTTP/1.1" status: 204 len: 168 time: 0.1941812 Nov 21 13:52:47.380189 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-610c1b90-42ef-424a-9973-9b19d00da73b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c4fb98e9-5fe1-4ede-9cdc-862abecc7f72,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:47.510876 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50540) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:47.524672 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d6862775-15cf-4c62-9682-c5e3c6c48a63 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.646663 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d6862775-15cf-4c62-9682-c5e3c6c48a63 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.652270 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d6862775-15cf-4c62-9682-c5e3c6c48a63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.703893 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-d6862775-15cf-4c62-9682-c5e3c6c48a63 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=95ed1833a5b94a3c8af5623acdf61b20&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1895561 Nov 21 13:52:47.703893 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6862775-15cf-4c62-9682-c5e3c6c48a63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=622eb408-a7da-4933-b9c9-298c76465b5e,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:47.715961 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50554) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:47.717792 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.db.resource_extend [None req-d4d96373-f8d0-4596-b1f4-cd19145e03c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 21 13:52:47.772636 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3efccac8-5fd2-4e6b-b6bf-2a6757720e2d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.784165 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50560) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:47.799649 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d4d96373-f8d0-4596-b1f4-cd19145e03c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.807360 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6f08aa00-618f-426b-a284-3b3e4b5f32f7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.810834 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3efccac8-5fd2-4e6b-b6bf-2a6757720e2d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.811063 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b79da8e3-df7d-4252-904b-932916bee27a req-bbdb87dc-265a-4929-88b2-2c09f9abd819 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:47.812558 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b79da8e3-df7d-4252-904b-932916bee27a req-bbdb87dc-265a-4929-88b2-2c09f9abd819 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.1718450 Nov 21 13:52:47.813671 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d4d96373-f8d0-4596-b1f4-cd19145e03c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.935650 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3efccac8-5fd2-4e6b-b6bf-2a6757720e2d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.939201 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3efccac8-5fd2-4e6b-b6bf-2a6757720e2d admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.941036 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-3efccac8-5fd2-4e6b-b6bf-2a6757720e2d admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/622eb408-a7da-4933-b9c9-298c76465b5e HTTP/1.1" status: 204 len: 168 time: 0.2233682 Nov 21 13:52:47.947939 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6f08aa00-618f-426b-a284-3b3e4b5f32f7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.956861 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3efccac8-5fd2-4e6b-b6bf-2a6757720e2d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=622eb408-a7da-4933-b9c9-298c76465b5e,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:47.959908 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6f08aa00-618f-426b-a284-3b3e4b5f32f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:47.994384 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f08aa00-618f-426b-a284-3b3e4b5f32f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e05ea56-4f92-4e79-88e2-ea3696f963a6,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:47.996704 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b79da8e3-df7d-4252-904b-932916bee27a req-987bdc8d-7434-4610-acc3-a31f4183a1ea tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1418643 Nov 21 13:52:48.014167 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.l3_db [None req-d4d96373-f8d0-4596-b1f4-cd19145e03c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Floating IP 5baecb0d-01e4-4ac3-967f-a8e540568d1f associated. External IP: 172.27.1.222, port: 627d561d-d2ff-449e-a99f-9e5e3fd874ba. Nov 21 13:52:48.025174 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-6f08aa00-618f-426b-a284-3b3e4b5f32f7 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=4983d99ec61b43e7a37440390c82cd01&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2399793 Nov 21 13:52:48.027964 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50572) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:48.089204 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0cb25e86-214a-4bed-b364-82185d9b7b2c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:48.111228 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0cb25e86-214a-4bed-b364-82185d9b7b2c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:48.161546 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0cb25e86-214a-4bed-b364-82185d9b7b2c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:48.164395 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0cb25e86-214a-4bed-b364-82185d9b7b2c admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:48.165839 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-0cb25e86-214a-4bed-b364-82185d9b7b2c admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0e05ea56-4f92-4e79-88e2-ea3696f963a6 HTTP/1.1" status: 204 len: 168 time: 0.1367576 Nov 21 13:52:48.173707 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb25e86-214a-4bed-b364-82185d9b7b2c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e05ea56-4f92-4e79-88e2-ea3696f963a6,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:48.248033 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d4d96373-f8d0-4596-b1f4-cd19145e03c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Router 0f049428-3827-4a0f-9254-57ee6dba40c0 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:52:48.367130 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d4d96373-f8d0-4596-b1f4-cd19145e03c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:52:48.378425 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60a092ac-f462-4fc7-9c07-8d9a408bb901 None None] Sync routers for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:52:48.379140 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d4d96373-f8d0-4596-b1f4-cd19145e03c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:48.394685 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60a092ac-f462-4fc7-9c07-8d9a408bb901 None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:52:48.395631 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-60a092ac-f462-4fc7-9c07-8d9a408bb901 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:52:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:48.409974 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-d4d96373-f8d0-4596-b1f4-cd19145e03c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "PUT /v2.0/floatingips/5baecb0d-01e4-4ac3-967f-a8e540568d1f HTTP/1.1" status: 200 len: 992 time: 1.7061923 Nov 21 13:52:48.409974 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba'}] {{(pid=109040) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:52:48.410658 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a0fb9e652e748194bc1d59d499050652e1260aa6f54aa3e041aed7364c74523c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a682a85a-23fb-44cf-b80c-fe75855a2c44" -d '{"events": [{"name": "network-changed", "server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]}' {{(pid=109040) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:52:48.518752 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-60a092ac-f462-4fc7-9c07-8d9a408bb901 None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:52:48.849363 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-60a092ac-f462-4fc7-9c07-8d9a408bb901 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': '5baecb0d-01e4-4ac3-967f-a8e540568d1f', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'floating_ip_address': '172.27.1.222', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'port_id': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 134, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'mac_address': 'fa:16:3e:1c:94:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:52:05Z', 'updated_at': '2021-11-21T13:52:47Z', 'revision_number': 1, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:59Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:48.876608 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60a092ac-f462-4fc7-9c07-8d9a408bb901 None None] Checking router: 0f049428-3827-4a0f-9254-57ee6dba40c0 for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:52:48.885301 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60a092ac-f462-4fc7-9c07-8d9a408bb901 None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:52:48.885918 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-60a092ac-f462-4fc7-9c07-8d9a408bb901 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:52:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:48.993675 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-60a092ac-f462-4fc7-9c07-8d9a408bb901 None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:52:49.249768 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-60a092ac-f462-4fc7-9c07-8d9a408bb901 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': '5baecb0d-01e4-4ac3-967f-a8e540568d1f', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'floating_ip_address': '172.27.1.222', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'port_id': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 134, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'mac_address': 'fa:16:3e:1c:94:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:52:05Z', 'updated_at': '2021-11-21T13:52:47Z', 'revision_number': 1, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:59Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:49.278036 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60a092ac-f462-4fc7-9c07-8d9a408bb901 None None] The sync data for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi is: [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': '5baecb0d-01e4-4ac3-967f-a8e540568d1f', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'floating_ip_address': '172.27.1.222', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'port_id': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 134, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'mac_address': 'fa:16:3e:1c:94:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:52:05Z', 'updated_at': '2021-11-21T13:52:47Z', 'revision_number': 1, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:59Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:52:49.519846 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3750fa62-2726-4747-b85d-4d615444ae10 None None] New status for floating IP 5baecb0d-01e4-4ac3-967f-a8e540568d1f: ACTIVE {{(pid=109042) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 13:52:50.036155 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 req-6d03f88e-a7b7-40f4-b9ee-9095095f1b16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:50.036840 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:52:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f18a7c89-f263-4af8-bdbb-6461be3d8e79 x-openstack-request-id: req-f18a7c89-f263-4af8-bdbb-6461be3d8e79 {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:52:50.037634 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba", "status": "completed", "code": 200}]} {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:52:50.038040 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-f18a7c89-f263-4af8-bdbb-6461be3d8e79 {{(pid=109040) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:52:50.038553 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 req-6d03f88e-a7b7-40f4-b9ee-9095095f1b16 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=c90104f2696540809e93549d7ed3695f&device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 1098 time: 0.0771074 Nov 21 13:52:50.038689 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'status': 'completed', 'code': 200} Nov 21 13:52:50.188142 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9216956-9cfc-4456-82c4-92d1f97c744a req-a0f14214-170e-4be8-943f-1991c5f86174 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:50.189663 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d9216956-9cfc-4456-82c4-92d1f97c744a req-a0f14214-170e-4be8-943f-1991c5f86174 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.1437039 Nov 21 13:52:50.225452 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-2ff6e067-c9bc-4624-9ad7-1a8405e16fe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:50.226877 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-2ff6e067-c9bc-4624-9ad7-1a8405e16fe5 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 1099 time: 0.1056914 Nov 21 13:52:50.235903 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 req-9a998590-3b08-4575-8f2d-03e38a027244 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:50.237777 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 req-9a998590-3b08-4575-8f2d-03e38a027244 service neutron] 10.222.0.50 "GET /v2.0/networks?id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a HTTP/1.1" status: 200 len: 919 time: 0.1814840 Nov 21 13:52:50.326667 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 req-583add8b-f669-4293-8f13-412810a102b5 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=dcf844c6-0002-4d63-9e63-4bf56191c807 HTTP/1.1" status: 200 len: 217 time: 0.0772259 Nov 21 13:52:50.348910 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d9216956-9cfc-4456-82c4-92d1f97c744a req-59ec2e68-6bfe-4f48-b8e9-014e46beb52f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1460509 Nov 21 13:52:50.427754 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 req-47e5189c-769e-4cdb-9fed-e80880b8e9d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:50.428939 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 req-47e5189c-769e-4cdb-9fed-e80880b8e9d4 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=a7f1c544-97e5-450d-9032-daf1d5a3a2a3 HTTP/1.1" status: 200 len: 858 time: 0.0849695 Nov 21 13:52:50.433575 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-02b45862-1b2a-4dff-b22f-5f459f491fac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:50.436985 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-02b45862-1b2a-4dff-b22f-5f459f491fac service neutron] 10.222.0.50 "GET /v2.0/networks?id=24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 200 len: 918 time: 0.1960521 Nov 21 13:52:50.488404 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 req-4bded08e-ca14-4320-a5c2-5b26a35e63bb service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0364773 Nov 21 13:52:50.610318 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-2088c6f5-5668-42f8-b115-b39368b190fd service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba HTTP/1.1" status: 200 len: 1002 time: 0.1471915 Nov 21 13:52:50.682011 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-f0ef058c-882f-4d26-b408-2b000d04dae1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:50.683495 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-f0ef058c-882f-4d26-b408-2b000d04dae1 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=c4887ea6-9c0e-4a7b-bd51-d70b335ceb92 HTTP/1.1" status: 200 len: 856 time: 0.0556796 Nov 21 13:52:50.725562 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 req-6b6b499e-0624-41e5-8727-f7d8ceaab708 service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2077203 Nov 21 13:52:50.748297 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-3e70de9e-0031-42fa-b0f6-a2804f8cafa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:50.750071 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-3e70de9e-0031-42fa-b0f6-a2804f8cafa4 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=24c864ef-5c5a-4df8-8968-78a7fe30b188&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0560904 Nov 21 13:52:51.165976 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-42d50da3-c0ba-4020-b1db-b08760a6d8e5 req-3fdbfb29-4d75-4715-b92e-b195138b5a35 service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4279008 Nov 21 13:52:51.176267 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dba7884f-2869-4f43-90c1-8aefe04e6194 req-01c8d8dd-dfd0-4ff8-81ff-044f31567db8 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:51.177745 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dba7884f-2869-4f43-90c1-8aefe04e6194 req-01c8d8dd-dfd0-4ff8-81ff-044f31567db8 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.1091495 Nov 21 13:52:51.179570 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-736d06c6-ae32-4420-97b1-0d39405dc6cb service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4169683 Nov 21 13:52:51.280592 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dba7884f-2869-4f43-90c1-8aefe04e6194 req-e2947ffc-b4b4-4dc8-b15a-4925f1a47724 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0964830 Nov 21 13:52:51.317390 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a682a85a-23fb-44cf-b80c-fe75855a2c44 req-7c624580-d5e1-403c-a83b-068090f97bac service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1183999 Nov 21 13:52:51.478584 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c87c799-b35e-456a-ac78-ab2799a502f5 req-e1003fa5-b772-4548-a00a-c58b009b7c4e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:51.480084 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7c87c799-b35e-456a-ac78-ab2799a502f5 req-e1003fa5-b772-4548-a00a-c58b009b7c4e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0536706 Nov 21 13:52:51.532219 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7c87c799-b35e-456a-ac78-ab2799a502f5 req-fd9c0b6a-ea5a-45f2-94ea-e73241a4383d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461233 Nov 21 13:52:51.806802 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1fce62ac-288d-4de2-adce-4fc9e3ab5c0f req-14b39b21-1d0b-4bf3-87b2-c7ac831a3d5c service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0397675 Nov 21 13:52:51.862772 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50772) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:51.910880 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fce62ac-288d-4de2-adce-4fc9e3ab5c0f req-a8e46c2f-633a-4697-97f3-40d01223e38a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:51.913160 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1fce62ac-288d-4de2-adce-4fc9e3ab5c0f req-a8e46c2f-633a-4697-97f3-40d01223e38a service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=c90104f2696540809e93549d7ed3695f&device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 1098 time: 0.0430088 Nov 21 13:52:52.001045 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-30c27336-961d-4db4-bd39-aa2f7b84a7ca admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:52.067423 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fce62ac-288d-4de2-adce-4fc9e3ab5c0f req-233a63be-5072-439c-b058-30ae23a45f9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:52.068935 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1fce62ac-288d-4de2-adce-4fc9e3ab5c0f req-233a63be-5072-439c-b058-30ae23a45f9a service neutron] 10.222.0.50 "GET /v2.0/networks?id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a HTTP/1.1" status: 200 len: 919 time: 0.1345532 Nov 21 13:52:52.133146 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1fce62ac-288d-4de2-adce-4fc9e3ab5c0f req-3631169c-b4ab-47bb-a451-8803c1edaf2d service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 HTTP/1.1" status: 200 len: 217 time: 0.0442948 Nov 21 13:52:52.155686 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-30c27336-961d-4db4-bd39-aa2f7b84a7ca admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:52.162894 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-30c27336-961d-4db4-bd39-aa2f7b84a7ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:52.238157 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30c27336-961d-4db4-bd39-aa2f7b84a7ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0afb4c94-be81-4f1b-86ba-e73ea7186ae3,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:52.245756 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-30c27336-961d-4db4-bd39-aa2f7b84a7ca admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=47bf47ca516a426492fdadc2d2ce6851&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3817334 Nov 21 13:52:52.248235 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 50806) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:52.259492 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fce62ac-288d-4de2-adce-4fc9e3ab5c0f req-2434b4a8-1ed8-4cf9-9493-e14d064ad9ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:52.261601 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1fce62ac-288d-4de2-adce-4fc9e3ab5c0f req-2434b4a8-1ed8-4cf9-9493-e14d064ad9ac service neutron] 10.222.0.50 "GET /v2.0/subnets?id=a7f1c544-97e5-450d-9032-daf1d5a3a2a3 HTTP/1.1" status: 200 len: 858 time: 0.0871367 Nov 21 13:52:52.308855 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1fce62ac-288d-4de2-adce-4fc9e3ab5c0f req-c4efd726-41d5-484a-b0ae-9f710e8b2c60 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0377913 Nov 21 13:52:52.346009 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2c4f296f-cc6f-4157-9a89-d3c901a4aa7f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:52.377861 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2c4f296f-cc6f-4157-9a89-d3c901a4aa7f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:52.447496 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2c4f296f-cc6f-4157-9a89-d3c901a4aa7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:52.450190 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2c4f296f-cc6f-4157-9a89-d3c901a4aa7f admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:52.453624 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-2c4f296f-cc6f-4157-9a89-d3c901a4aa7f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0afb4c94-be81-4f1b-86ba-e73ea7186ae3 HTTP/1.1" status: 204 len: 168 time: 0.2017691 Nov 21 13:52:52.484241 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c4f296f-cc6f-4157-9a89-d3c901a4aa7f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0afb4c94-be81-4f1b-86ba-e73ea7186ae3,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:52.497073 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:52.501732 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8aed061-f79e-45bd-99ec-2dcc6081aafc req-8949634a-8b0c-4d54-9351-baa2a9d13117 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:52.505201 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d8aed061-f79e-45bd-99ec-2dcc6081aafc req-8949634a-8b0c-4d54-9351-baa2a9d13117 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.1036780 Nov 21 13:52:52.572263 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1fce62ac-288d-4de2-adce-4fc9e3ab5c0f req-325f4ac1-26d0-487c-a046-6679c88577af service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2407281 Nov 21 13:52:52.720457 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d8aed061-f79e-45bd-99ec-2dcc6081aafc req-14f48968-e4e5-4a1c-a7cd-af5e3e96b82c tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1893942 Nov 21 13:52:52.741836 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffae09e4-b4ee-4600-92d7-1d1af38d1350 req-bd0f4922-dd95-4dc8-a004-2c84f7aea6ad tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:52.750520 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ffae09e4-b4ee-4600-92d7-1d1af38d1350 req-bd0f4922-dd95-4dc8-a004-2c84f7aea6ad tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.1122386 Nov 21 13:52:52.770118 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1fce62ac-288d-4de2-adce-4fc9e3ab5c0f req-c9ee3e1e-9640-426a-8750-e6bc5f497a3f service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1637521 Nov 21 13:52:52.856353 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ffae09e4-b4ee-4600-92d7-1d1af38d1350 req-7a145028-7dc7-4bcf-901b-982e3ae679c7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1025345 Nov 21 13:52:52.976562 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 50854) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:52.989171 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1a80471f-2823-4efc-abc3-ef959cb5d957 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:53.085811 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1a80471f-2823-4efc-abc3-ef959cb5d957 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:53.090877 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1a80471f-2823-4efc-abc3-ef959cb5d957 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:53.126376 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-1a80471f-2823-4efc-abc3-ef959cb5d957 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=49bc12649ba84cc8a1c3ccbbeb8dd868&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1487381 Nov 21 13:52:53.129877 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50864) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:53.131963 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a80471f-2823-4efc-abc3-ef959cb5d957 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ca531381-6772-4cca-95bd-b51cb555d967,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:53.188540 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-13f2cc5b-7a01-40de-ba46-41cb1061fe30 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:53.210654 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-13f2cc5b-7a01-40de-ba46-41cb1061fe30 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:53.264498 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-13f2cc5b-7a01-40de-ba46-41cb1061fe30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:53.267282 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-13f2cc5b-7a01-40de-ba46-41cb1061fe30 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:53.271776 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-13f2cc5b-7a01-40de-ba46-41cb1061fe30 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ca531381-6772-4cca-95bd-b51cb555d967 HTTP/1.1" status: 204 len: 168 time: 0.1408057 Nov 21 13:52:53.281685 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13f2cc5b-7a01-40de-ba46-41cb1061fe30 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca531381-6772-4cca-95bd-b51cb555d967,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:53.540444 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 req-440187fb-7437-46ca-afd6-121be534a2fb tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:53.541890 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 req-440187fb-7437-46ca-afd6-121be534a2fb tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.50 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0472655 Nov 21 13:52:53.674220 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 req-6853fb27-7235-4285-9ef0-95672a6d5cb4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Deleting port 8653e663-5da8-4b7e-91b0-8c94d45d51ad {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:52:53.675108 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 req-6853fb27-7235-4285-9ef0-95672a6d5cb4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:53.771145 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 req-6853fb27-7235-4285-9ef0-95672a6d5cb4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] For port 8653e663-5da8-4b7e-91b0-8c94d45d51ad, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8653e663-5da8-4b7e-91b0-8c94d45d51ad,segment=NetworkSegment(af3504fe-7a5c-4c47-a5ed-ae3a2be59084),segment_id=af3504fe-7a5c-4c47-a5ed-ae3a2be59084)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:52:53.771522 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 req-6853fb27-7235-4285-9ef0-95672a6d5cb4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:53.788175 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 req-6853fb27-7235-4285-9ef0-95672a6d5cb4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Calling delete_port for 8653e663-5da8-4b7e-91b0-8c94d45d51ad owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:52:53.922877 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b5aa333-8a38-4cab-a0c4-b115d4606d26 req-2faebe5e-ba6c-42a7-b74b-bc6b9a08ed9c tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:53.928323 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2b5aa333-8a38-4cab-a0c4-b115d4606d26 req-2faebe5e-ba6c-42a7-b74b-bc6b9a08ed9c tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 945 time: 0.0728450 Nov 21 13:52:53.993158 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2291d560-8cd6-4f0f-af03-6720ff4d9ce8 req-096f8af4-da28-4167-8da9-e0f8ced74742 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:54.000629 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2291d560-8cd6-4f0f-af03-6720ff4d9ce8 req-096f8af4-da28-4167-8da9-e0f8ced74742 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0548124 Nov 21 13:52:54.006667 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2b5aa333-8a38-4cab-a0c4-b115d4606d26 req-dc0910b0-9997-44d6-8230-3947c54dcf01 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/security-groups?id=b5367324-7c98-4213-b67a-a2a436c640c1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0758455 Nov 21 13:52:54.049237 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 req-6853fb27-7235-4285-9ef0-95672a6d5cb4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:54.052128 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2291d560-8cd6-4f0f-af03-6720ff4d9ce8 req-b9615816-5706-471e-a9ad-b5c713bc9653 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501962 Nov 21 13:52:54.068076 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['8653e663-5da8-4b7e-91b0-8c94d45d51ad'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:52:54.090776 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6853fb27-7235-4285-9ef0-95672a6d5cb4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Pushing event deleted for resources: {'Port': ['ID=8653e663-5da8-4b7e-91b0-8c94d45d51ad,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:54.176603 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 req-6853fb27-7235-4285-9ef0-95672a6d5cb4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] No DVR routers for this DVR port 8653e663-5da8-4b7e-91b0-8c94d45d51ad on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:52:54.180456 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 req-6853fb27-7235-4285-9ef0-95672a6d5cb4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:54.184616 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-06e7c9b9-5896-4935-9ee1-c7adcefecc25 req-6853fb27-7235-4285-9ef0-95672a6d5cb4 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.50 "DELETE /v2.0/ports/8653e663-5da8-4b7e-91b0-8c94d45d51ad HTTP/1.1" status: 204 len: 173 time: 0.6338148 Nov 21 13:52:54.184998 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f7ac629e-e375-4954-82d0-1efb9da7da3b', 'name': 'network-vif-deleted', 'tag': '8653e663-5da8-4b7e-91b0-8c94d45d51ad'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:52:54.189123 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b2957732-ae09-4608-8bb2-aa42ca09f93f" -d '{"events": [{"server_uuid": "f7ac629e-e375-4954-82d0-1efb9da7da3b", "name": "network-vif-deleted", "tag": "8653e663-5da8-4b7e-91b0-8c94d45d51ad"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:52:54.236389 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:52:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ebc2d71-fd6d-4c15-8dc1-427857dbd212 x-openstack-request-id: req-7ebc2d71-fd6d-4c15-8dc1-427857dbd212 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:52:54.236774 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f7ac629e-e375-4954-82d0-1efb9da7da3b", "name": "network-vif-deleted", "tag": "8653e663-5da8-4b7e-91b0-8c94d45d51ad", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:52:54.237667 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-7ebc2d71-fd6d-4c15-8dc1-427857dbd212 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:52:54.238162 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f7ac629e-e375-4954-82d0-1efb9da7da3b', 'name': 'network-vif-deleted', 'tag': '8653e663-5da8-4b7e-91b0-8c94d45d51ad', 'status': 'completed', 'code': 200} Nov 21 13:52:54.545479 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50936) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:54.716017 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b2886553-b323-4ecc-8ed0-18afc6425248 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:54.823119 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b2886553-b323-4ecc-8ed0-18afc6425248 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:54.829278 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b2886553-b323-4ecc-8ed0-18afc6425248 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:54.879264 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2886553-b323-4ecc-8ed0-18afc6425248 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9bc96523-90e0-43fd-81da-10971ba968ac,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:54.894513 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-b2886553-b323-4ecc-8ed0-18afc6425248 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=b02414ba98a84522b24033b0087feebc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3471811 Nov 21 13:52:54.897103 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 50952) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:54.961719 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4ad12fcf-ef32-4f97-b6ed-b2c7b625a285 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:54.984924 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4ad12fcf-ef32-4f97-b6ed-b2c7b625a285 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.038845 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4ad12fcf-ef32-4f97-b6ed-b2c7b625a285 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.041479 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4ad12fcf-ef32-4f97-b6ed-b2c7b625a285 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.055700 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-4ad12fcf-ef32-4f97-b6ed-b2c7b625a285 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/9bc96523-90e0-43fd-81da-10971ba968ac HTTP/1.1" status: 204 len: 168 time: 0.1576166 Nov 21 13:52:55.073226 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ad12fcf-ef32-4f97-b6ed-b2c7b625a285 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9bc96523-90e0-43fd-81da-10971ba968ac,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:55.152570 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-6c7cf9ee-96a4-4017-98f0-9d699385648e req-1457140a-3503-49f6-8c4e-e9d1e4262b02 tempest-DeleteServersTestJSON-802788546 tempest-DeleteServersTestJSON-802788546-project] 10.222.0.11 "GET /v2.0/ports?device_id=f7ac629e-e375-4954-82d0-1efb9da7da3b HTTP/1.1" status: 200 len: 210 time: 0.0373108 Nov 21 13:52:55.272259 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45de2312-5fd9-4d9b-b35f-095cfb23536f req-73a4e933-ece6-4cb9-9aef-e13c456d6e5f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:55.281265 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-45de2312-5fd9-4d9b-b35f-095cfb23536f req-73a4e933-ece6-4cb9-9aef-e13c456d6e5f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0990243 Nov 21 13:52:55.347654 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-45de2312-5fd9-4d9b-b35f-095cfb23536f req-76c193ba-9aab-4e0a-b096-b51d6cd7f565 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653889 Nov 21 13:52:55.537722 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50984) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:55.552512 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6de2d90b-d35e-47c6-bb15-7aae1b67aa4b admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.619754 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 50988) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:55.626319 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50990) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:55.665535 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6de2d90b-d35e-47c6-bb15-7aae1b67aa4b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.673903 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6de2d90b-d35e-47c6-bb15-7aae1b67aa4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.718797 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-6de2d90b-d35e-47c6-bb15-7aae1b67aa4b admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=43150589a0bc474b85dcda0cbf4f663e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1773109 Nov 21 13:52:55.720237 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de2d90b-d35e-47c6-bb15-7aae1b67aa4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=101f9c7d-5f6c-42e6-a60f-43d841f334e2,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:55.723369 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 50996) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:55.740913 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ec38da1c-e526-45be-8303-9e55bb161828 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.741677 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-64e213bd-0711-4e70-94e4-5f5384af7976 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.807448 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6ced3bf3-0030-45c9-9c67-b13e1aa36306 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.819929 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-64e213bd-0711-4e70-94e4-5f5384af7976 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.824026 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-64e213bd-0711-4e70-94e4-5f5384af7976 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.840234 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6ced3bf3-0030-45c9-9c67-b13e1aa36306 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.859929 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e213bd-0711-4e70-94e4-5f5384af7976 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b57da3b-f6f3-4056-aa8d-03d2727255dd,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:55.864992 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-64e213bd-0711-4e70-94e4-5f5384af7976 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=83d8b59a94df4f53aef1e17e85725496&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2368829 Nov 21 13:52:55.866976 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 50998) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:55.890681 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ec38da1c-e526-45be-8303-9e55bb161828 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.895314 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ec38da1c-e526-45be-8303-9e55bb161828 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.915593 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1fe8ba4d-9358-4be7-9c7d-1351d9191405 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.936066 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6ced3bf3-0030-45c9-9c67-b13e1aa36306 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.936876 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1fe8ba4d-9358-4be7-9c7d-1351d9191405 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.938535 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6ced3bf3-0030-45c9-9c67-b13e1aa36306 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:55.942968 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-6ced3bf3-0030-45c9-9c67-b13e1aa36306 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/101f9c7d-5f6c-42e6-a60f-43d841f334e2 HTTP/1.1" status: 204 len: 168 time: 0.2144852 Nov 21 13:52:55.944001 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-ec38da1c-e526-45be-8303-9e55bb161828 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=88e6dbd066b44d1bbaf31dc4ba85ba48&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3230913 Nov 21 13:52:55.945059 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec38da1c-e526-45be-8303-9e55bb161828 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f148993-6313-4ba8-9f28-fe173b1b23b6,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:55.946547 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51004) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:55.956398 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ced3bf3-0030-45c9-9c67-b13e1aa36306 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=101f9c7d-5f6c-42e6-a60f-43d841f334e2,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:56.019620 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5fc8367f-b6ee-488b-8bdb-66c2a42587d5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.035874 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1fe8ba4d-9358-4be7-9c7d-1351d9191405 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.038627 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1fe8ba4d-9358-4be7-9c7d-1351d9191405 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.039743 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-1fe8ba4d-9358-4be7-9c7d-1351d9191405 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/6b57da3b-f6f3-4056-aa8d-03d2727255dd HTTP/1.1" status: 204 len: 168 time: 0.1718550 Nov 21 13:52:56.054702 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fe8ba4d-9358-4be7-9c7d-1351d9191405 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b57da3b-f6f3-4056-aa8d-03d2727255dd,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:56.068509 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5fc8367f-b6ee-488b-8bdb-66c2a42587d5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.142054 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5fc8367f-b6ee-488b-8bdb-66c2a42587d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.160616 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5fc8367f-b6ee-488b-8bdb-66c2a42587d5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.160616 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-5fc8367f-b6ee-488b-8bdb-66c2a42587d5 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/2f148993-6313-4ba8-9f28-fe173b1b23b6 HTTP/1.1" status: 204 len: 168 time: 0.2038536 Nov 21 13:52:56.164116 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fc8367f-b6ee-488b-8bdb-66c2a42587d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f148993-6313-4ba8-9f28-fe173b1b23b6,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:56.355572 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51036) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:56.387292 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-90943060-d04a-444c-a559-8ecade22bdc5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.543233 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad1091a-6e3d-4374-b23b-6d36a303b9f4 req-3405c6e4-3885-431a-a70d-1aed95e60b03 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:56.544997 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-bad1091a-6e3d-4374-b23b-6d36a303b9f4 req-3405c6e4-3885-431a-a70d-1aed95e60b03 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0757697 Nov 21 13:52:56.559290 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-90943060-d04a-444c-a559-8ecade22bdc5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.567192 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-90943060-d04a-444c-a559-8ecade22bdc5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.602408 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51048) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:56.630776 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a2897a66-eeb0-4eeb-b746-abee5e0d5fdd admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.649462 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-bad1091a-6e3d-4374-b23b-6d36a303b9f4 req-ce65cb76-14f5-4723-83ed-f11230903b65 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0865934 Nov 21 13:52:56.652542 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-90943060-d04a-444c-a559-8ecade22bdc5 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=3b2d176d41a247afaa589f755a0c37fa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2933919 Nov 21 13:52:56.653894 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51054) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:56.671130 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90943060-d04a-444c-a559-8ecade22bdc5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ae68492-7a82-4d5d-85c7-959c37e698a8,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:56.753416 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f10bc1b7-960a-41f0-a5e5-4edec6bb08f8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.790813 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f10bc1b7-960a-41f0-a5e5-4edec6bb08f8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.804034 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a2897a66-eeb0-4eeb-b746-abee5e0d5fdd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.812590 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a2897a66-eeb0-4eeb-b746-abee5e0d5fdd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.850806 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51058) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:56.860165 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-a2897a66-eeb0-4eeb-b746-abee5e0d5fdd admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=6ca1f2dad4ef42bab413f77348dc96af&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2537858 Nov 21 13:52:56.864095 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51060) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:56.867004 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5ffdee5f-14bf-4c2c-9fe2-ff47881b0a4e admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.878422 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2897a66-eeb0-4eeb-b746-abee5e0d5fdd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e9b841c-96d3-4e49-b316-48baf026fa75,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:56.909636 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f10bc1b7-960a-41f0-a5e5-4edec6bb08f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.912116 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f10bc1b7-960a-41f0-a5e5-4edec6bb08f8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.915915 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-f10bc1b7-960a-41f0-a5e5-4edec6bb08f8 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0ae68492-7a82-4d5d-85c7-959c37e698a8 HTTP/1.1" status: 204 len: 168 time: 0.2580533 Nov 21 13:52:56.928918 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-e9f6f9fc-889b-4989-abbd-582348b8f318 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.930745 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f10bc1b7-960a-41f0-a5e5-4edec6bb08f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ae68492-7a82-4d5d-85c7-959c37e698a8,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:56.960114 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-e9f6f9fc-889b-4989-abbd-582348b8f318 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.978724 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5ffdee5f-14bf-4c2c-9fe2-ff47881b0a4e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:56.983260 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5ffdee5f-14bf-4c2c-9fe2-ff47881b0a4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:57.014032 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-e9f6f9fc-889b-4989-abbd-582348b8f318 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:57.017082 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-e9f6f9fc-889b-4989-abbd-582348b8f318 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:57.018337 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-e9f6f9fc-889b-4989-abbd-582348b8f318 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/9e9b841c-96d3-4e49-b316-48baf026fa75 HTTP/1.1" status: 204 len: 168 time: 0.1526833 Nov 21 13:52:57.027243 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9f6f9fc-889b-4989-abbd-582348b8f318 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e9b841c-96d3-4e49-b316-48baf026fa75,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:57.038564 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ffdee5f-14bf-4c2c-9fe2-ff47881b0a4e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97d0ae86-82ee-476d-9ee5-9baa9c1927af,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:57.051881 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-5ffdee5f-14bf-4c2c-9fe2-ff47881b0a4e admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=b34d33fd9db141a597ff66e015656157&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1994824 Nov 21 13:52:57.054831 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51066) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:57.116602 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1b6fcb58-870a-45d6-ad4e-76d53b4f1391 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:57.140065 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1b6fcb58-870a-45d6-ad4e-76d53b4f1391 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:57.201835 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1b6fcb58-870a-45d6-ad4e-76d53b4f1391 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:57.204739 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1b6fcb58-870a-45d6-ad4e-76d53b4f1391 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:57.206348 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-1b6fcb58-870a-45d6-ad4e-76d53b4f1391 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/97d0ae86-82ee-476d-9ee5-9baa9c1927af HTTP/1.1" status: 204 len: 168 time: 0.1503367 Nov 21 13:52:57.215066 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b6fcb58-870a-45d6-ad4e-76d53b4f1391 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97d0ae86-82ee-476d-9ee5-9baa9c1927af,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:57.351620 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 8653e663-5da8-4b7e-91b0-8c94d45d51ad no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:52:57.381768 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: 8653e663-5da8-4b7e-91b0-8c94d45d51ad {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:52:57.382373 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 8653e663-5da8-4b7e-91b0-8c94d45d51ad not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:52:57.617810 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:52:57.788075 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a08be99e-4fb6-4926-8438-2fbb7da1f445 req-ccaa0b53-02c8-42b2-ad71-271e2a86abd1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:57.789603 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a08be99e-4fb6-4926-8438-2fbb7da1f445 req-ccaa0b53-02c8-42b2-ad71-271e2a86abd1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0563011 Nov 21 13:52:57.856593 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a08be99e-4fb6-4926-8438-2fbb7da1f445 req-63c951c2-49e7-49f6-91c3-c112ad01122d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0596855 Nov 21 13:52:57.895065 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51130) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:57.944384 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_v2 [None req-f0e2bc81-b845-4ed2-b3fb-3a51bdfee8f4 admin admin] Deleting subnet b2250609-3053-4cfc-afb4-7edd4f2f599d {{(pid=109041) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 13:52:57.947422 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f0e2bc81-b845-4ed2-b3fb-3a51bdfee8f4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:57.989553 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f0e2bc81-b845-4ed2-b3fb-3a51bdfee8f4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4028984'] for subnet, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.037384 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f0e2bc81-b845-4ed2-b3fb-3a51bdfee8f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.041280 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51138) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:58.119026 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f0e2bc81-b845-4ed2-b3fb-3a51bdfee8f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3086848', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261005199'] for subnet, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.146435 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0e2bc81-b845-4ed2-b3fb-3a51bdfee8f4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b2250609-3053-4cfc-afb4-7edd4f2f599d,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:58.152504 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f0e2bc81-b845-4ed2-b3fb-3a51bdfee8f4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.156042 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-f0e2bc81-b845-4ed2-b3fb-3a51bdfee8f4 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/b2250609-3053-4cfc-afb4-7edd4f2f599d HTTP/1.1" status: 204 len: 168 time: 0.2587457 Nov 21 13:52:58.158447 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51146) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:58.230345 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-85e43bad-fdff-4f2b-921c-c6135b602794 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.264642 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6f208aaf-4c8d-4f35-a207-e0056c4cf896 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.387772 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6f208aaf-4c8d-4f35-a207-e0056c4cf896 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.407701 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-85e43bad-fdff-4f2b-921c-c6135b602794 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.416837 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-85e43bad-fdff-4f2b-921c-c6135b602794 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.429050 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-6f208aaf-4c8d-4f35-a207-e0056c4cf896 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['329f6f8a-93b1-430a-8c57-dacb018278ff']}} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:58.458003 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-6f208aaf-4c8d-4f35-a207-e0056c4cf896 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'af3504fe-7a5c-4c47-a5ed-ae3a2be59084') {'for_net_delete': True} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:58.458300 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-6f208aaf-4c8d-4f35-a207-e0056c4cf896 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'af3504fe-7a5c-4c47-a5ed-ae3a2be59084') {} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:52:58.470391 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-85e43bad-fdff-4f2b-921c-c6135b602794 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=423596d461924475879be77f6bdccefa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4281256 Nov 21 13:52:58.473257 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51162) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:58.476037 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6f208aaf-4c8d-4f35-a207-e0056c4cf896 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4028979'] for segment, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.484457 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85e43bad-fdff-4f2b-921c-c6135b602794 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=52e37266-245b-46ae-9a69-fcc768cc913e,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:58.494406 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6f208aaf-4c8d-4f35-a207-e0056c4cf896 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.503404 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6f208aaf-4c8d-4f35-a207-e0056c4cf896 admin admin] Releasing vlan 549 on physical network physnet1 to pool {{(pid=109041) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 13:52:58.504078 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6f208aaf-4c8d-4f35-a207-e0056c4cf896 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3087018'] for segment, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: Traceback (most recent call last): Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: timer() Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: cb(*args, **kw) Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: return func(*args, **kwargs) Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: self._notify() Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: self.callback(batched_events) Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: event.method(event) Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: return f(self, *a, **k) Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._get(url).json() Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: return self.request(url, 'GET', **kwargs) Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 13:52:58.505975 dv-cinder-768458-12-iscsi neutron-server[109041]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 13:52:58.563900 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d7ec5006-98ae-4e65-a4c7-2c8be8d0e0f7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.564872 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6f208aaf-4c8d-4f35-a207-e0056c4cf896 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.571537 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6f208aaf-4c8d-4f35-a207-e0056c4cf896 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.577005 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-6f208aaf-4c8d-4f35-a207-e0056c4cf896 admin admin] 10.222.0.11 "DELETE /v2.0/networks/329f6f8a-93b1-430a-8c57-dacb018278ff HTTP/1.1" status: 204 len: 168 time: 0.4151919 Nov 21 13:52:58.588791 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f208aaf-4c8d-4f35-a207-e0056c4cf896 admin admin] Pushing event deleted for resources: {'Network': ['ID=329f6f8a-93b1-430a-8c57-dacb018278ff,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:58.589491 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d7ec5006-98ae-4e65-a4c7-2c8be8d0e0f7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.640518 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d7ec5006-98ae-4e65-a4c7-2c8be8d0e0f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.643426 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d7ec5006-98ae-4e65-a4c7-2c8be8d0e0f7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:58.647200 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-d7ec5006-98ae-4e65-a4c7-2c8be8d0e0f7 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/52e37266-245b-46ae-9a69-fcc768cc913e HTTP/1.1" status: 204 len: 168 time: 0.1729412 Nov 21 13:52:58.654771 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7ec5006-98ae-4e65-a4c7-2c8be8d0e0f7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=52e37266-245b-46ae-9a69-fcc768cc913e,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:58.853544 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51180) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:58.904358 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-6738e5e0-d8f2-417a-aad7-b64c77a1e0c5 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9580a66e32944e649fafe038a1d4cc4a&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0465455 Nov 21 13:52:58.904715 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51186) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:59.011642 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18fcc76e-df14-4e3c-befb-2141538eb0b8 req-4835810a-0ee3-456e-894a-76f64c094485 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:52:59.020582 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-18fcc76e-df14-4e3c-befb-2141538eb0b8 req-4835810a-0ee3-456e-894a-76f64c094485 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0864017 Nov 21 13:52:59.021591 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-83feffb8-aa52-4851-9c04-9d988dc3dd5c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.070116 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-83feffb8-aa52-4851-9c04-9d988dc3dd5c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.105283 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-18fcc76e-df14-4e3c-befb-2141538eb0b8 req-5ed1cb94-0b52-41c6-90fe-b7f215d0e5d1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0804048 Nov 21 13:52:59.140522 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-83feffb8-aa52-4851-9c04-9d988dc3dd5c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.143521 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-83feffb8-aa52-4851-9c04-9d988dc3dd5c admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.144625 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-83feffb8-aa52-4851-9c04-9d988dc3dd5c admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/b5367324-7c98-4213-b67a-a2a436c640c1 HTTP/1.1" status: 204 len: 168 time: 0.2386236 Nov 21 13:52:59.152327 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83feffb8-aa52-4851-9c04-9d988dc3dd5c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5367324-7c98-4213-b67a-a2a436c640c1,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:59.255428 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51200) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:59.312281 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51206) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:59.325609 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5520be56-d51d-48cd-9e7d-3ff219710012 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.405139 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5520be56-d51d-48cd-9e7d-3ff219710012 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.409539 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5520be56-d51d-48cd-9e7d-3ff219710012 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.449724 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-5520be56-d51d-48cd-9e7d-3ff219710012 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=33843ccd33404000915da97f938f2138&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1337106 Nov 21 13:52:59.449892 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51210) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:59.457375 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5520be56-d51d-48cd-9e7d-3ff219710012 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4d8ae21-c80a-4627-ae3c-d97105d30eef,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:59.515034 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5dd74ae6-a143-4080-9a83-a8f3a614311c admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.517047 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-87313642-7841-42ce-b833-e82ba1baf2db admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.550976 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-87313642-7841-42ce-b833-e82ba1baf2db admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.633194 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-87313642-7841-42ce-b833-e82ba1baf2db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.635902 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-87313642-7841-42ce-b833-e82ba1baf2db admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.639411 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-87313642-7841-42ce-b833-e82ba1baf2db admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/e4d8ae21-c80a-4627-ae3c-d97105d30eef HTTP/1.1" status: 204 len: 168 time: 0.1863551 Nov 21 13:52:59.650108 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87313642-7841-42ce-b833-e82ba1baf2db admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4d8ae21-c80a-4627-ae3c-d97105d30eef,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:59.684116 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5dd74ae6-a143-4080-9a83-a8f3a614311c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.688582 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5dd74ae6-a143-4080-9a83-a8f3a614311c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.733129 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-5dd74ae6-a143-4080-9a83-a8f3a614311c admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=a031de4458f442d688fb93962e322072&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4765038 Nov 21 13:52:59.734344 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dd74ae6-a143-4080-9a83-a8f3a614311c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4a68b83-5cf9-4472-82c8-778f281db41a,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:52:59.735982 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51226) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:52:59.800215 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-51dba7d7-614e-4cd0-bbb7-17ee8ffcf61b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.827004 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-51dba7d7-614e-4cd0-bbb7-17ee8ffcf61b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.879288 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-51dba7d7-614e-4cd0-bbb7-17ee8ffcf61b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.882649 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-51dba7d7-614e-4cd0-bbb7-17ee8ffcf61b admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:52:59.883971 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-51dba7d7-614e-4cd0-bbb7-17ee8ffcf61b admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/e4a68b83-5cf9-4472-82c8-778f281db41a HTTP/1.1" status: 204 len: 168 time: 0.1442966 Nov 21 13:52:59.891413 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51dba7d7-614e-4cd0-bbb7-17ee8ffcf61b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4a68b83-5cf9-4472-82c8-778f281db41a,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:00.164681 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-83760b32-c848-4c53-b132-2c23df437b22 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:00.195769 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51252) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:00.209511 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-261b69ee-ccde-435b-a9bf-f03894a5ef6c admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:00.258881 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41e4a91-5e97-4f49-8054-5645cf01bd94 req-36d93324-a6c9-4795-befb-d22aeee56191 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:00.268372 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e41e4a91-5e97-4f49-8054-5645cf01bd94 req-36d93324-a6c9-4795-befb-d22aeee56191 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0792360 Nov 21 13:53:00.294743 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-261b69ee-ccde-435b-a9bf-f03894a5ef6c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:00.301504 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-261b69ee-ccde-435b-a9bf-f03894a5ef6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:00.330679 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-261b69ee-ccde-435b-a9bf-f03894a5ef6c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=99107afd-3a96-4a28-b3b5-31b6e4ee27dd,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:00.351053 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-261b69ee-ccde-435b-a9bf-f03894a5ef6c admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=f5ec58dab83d48439c40c735dba764d7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1520216 Nov 21 13:53:00.351294 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51258) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:00.388493 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e41e4a91-5e97-4f49-8054-5645cf01bd94 req-79f5c36c-86fa-48b0-b78f-2bc139227982 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1190407 Nov 21 13:53:00.407093 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3e0c338a-9057-4da1-a534-49de1e5625ab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:00.430826 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3e0c338a-9057-4da1-a534-49de1e5625ab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:00.483331 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3e0c338a-9057-4da1-a534-49de1e5625ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:00.486289 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3e0c338a-9057-4da1-a534-49de1e5625ab admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:00.487681 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-3e0c338a-9057-4da1-a534-49de1e5625ab admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/99107afd-3a96-4a28-b3b5-31b6e4ee27dd HTTP/1.1" status: 204 len: 168 time: 0.1354570 Nov 21 13:53:00.495789 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e0c338a-9057-4da1-a534-49de1e5625ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=99107afd-3a96-4a28-b3b5-31b6e4ee27dd,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:01.497803 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa8c95c-100e-41fb-9fff-d125d6746d6c req-73ad67dd-04f2-4cc5-a31a-c2ad50e82eb3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:01.500081 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ffa8c95c-100e-41fb-9fff-d125d6746d6c req-73ad67dd-04f2-4cc5-a31a-c2ad50e82eb3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0534153 Nov 21 13:53:01.561391 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ffa8c95c-100e-41fb-9fff-d125d6746d6c req-939665ba-03e7-4f59-899c-64af63874e92 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499556 Nov 21 13:53:02.555118 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e48648fc-f66e-4d8a-8f31-2cb0540ae5bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:02.680045 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fec403da-ede8-4a67-9b1c-0c36d8bd400e req-863649cd-7c47-4290-b20b-ef097e89cf5d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:02.681527 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fec403da-ede8-4a67-9b1c-0c36d8bd400e req-863649cd-7c47-4290-b20b-ef097e89cf5d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0505807 Nov 21 13:53:02.752780 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fec403da-ede8-4a67-9b1c-0c36d8bd400e req-7d28880c-8234-41c3-a7dc-e19535b5106f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634181 Nov 21 13:53:03.855228 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:03.895041 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4ebf1c-8b06-409b-8de7-76fd7835b2ce req-2c97830c-f814-4bab-8ddc-73c33b11307f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:03.896542 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5d4ebf1c-8b06-409b-8de7-76fd7835b2ce req-2c97830c-f814-4bab-8ddc-73c33b11307f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0579414 Nov 21 13:53:03.959008 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5d4ebf1c-8b06-409b-8de7-76fd7835b2ce req-f1e4b9fe-6866-453e-bd82-3c78c5f3460b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552623 Nov 21 13:53:04.080151 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51526) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:04.187459 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e5a23b03-e869-439b-8e24-fb27e45bc5ab admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:04.267372 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e5a23b03-e869-439b-8e24-fb27e45bc5ab admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:04.271146 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e5a23b03-e869-439b-8e24-fb27e45bc5ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:04.311170 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-e5a23b03-e869-439b-8e24-fb27e45bc5ab admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=be453604deef4656b955101b1e3e0e27&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2297697 Nov 21 13:53:04.311998 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5a23b03-e869-439b-8e24-fb27e45bc5ab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9ac41b8-6740-434f-9559-6cf6c7316e3f,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:04.313711 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51538) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:04.364818 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8ec301a5-69ba-4df9-bd15-9df964cb415d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:04.385961 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8ec301a5-69ba-4df9-bd15-9df964cb415d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:04.436534 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8ec301a5-69ba-4df9-bd15-9df964cb415d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:04.440502 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8ec301a5-69ba-4df9-bd15-9df964cb415d admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:04.441681 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-8ec301a5-69ba-4df9-bd15-9df964cb415d admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/c9ac41b8-6740-434f-9559-6cf6c7316e3f HTTP/1.1" status: 204 len: 168 time: 0.1269250 Nov 21 13:53:04.449801 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ec301a5-69ba-4df9-bd15-9df964cb415d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9ac41b8-6740-434f-9559-6cf6c7316e3f,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:04.626284 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51562) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:04.716453 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51566) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:04.729635 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b981816d-058d-43bc-a132-b2a14779d5d3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:04.756110 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c95d62c7-93ff-41e2-8904-93ccb349d059 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:04.856643 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b981816d-058d-43bc-a132-b2a14779d5d3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:04.866533 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b981816d-058d-43bc-a132-b2a14779d5d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:04.907737 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c95d62c7-93ff-41e2-8904-93ccb349d059 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:04.918729 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-b981816d-058d-43bc-a132-b2a14779d5d3 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=ca8bf41e6dc44f7198331f57d9fbb2c4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2012637 Nov 21 13:53:04.919493 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c95d62c7-93ff-41e2-8904-93ccb349d059 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:04.921806 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51570) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:04.924669 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b981816d-058d-43bc-a132-b2a14779d5d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=032690f0-4dd3-4567-a404-d0aa18d059d2,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:04.959897 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-c95d62c7-93ff-41e2-8904-93ccb349d059 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=ace11380f9374d6d90550f27991adc3e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3321457 Nov 21 13:53:04.963149 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51572) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:04.965048 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c95d62c7-93ff-41e2-8904-93ccb349d059 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b32c1fc-ee6f-42e1-826e-7ed0ac2ad390,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:04.983970 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-44c5bfc6-68ed-4d7f-abf5-cff3fab6c881 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.022469 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-44c5bfc6-68ed-4d7f-abf5-cff3fab6c881 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.041565 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.058046 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8939b024-1b54-4a24-8b3a-fd5d37837cff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.082796 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8939b024-1b54-4a24-8b3a-fd5d37837cff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.100354 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-44c5bfc6-68ed-4d7f-abf5-cff3fab6c881 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.102850 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-44c5bfc6-68ed-4d7f-abf5-cff3fab6c881 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.104005 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-44c5bfc6-68ed-4d7f-abf5-cff3fab6c881 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/032690f0-4dd3-4567-a404-d0aa18d059d2 HTTP/1.1" status: 204 len: 168 time: 0.1805468 Nov 21 13:53:05.123199 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44c5bfc6-68ed-4d7f-abf5-cff3fab6c881 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=032690f0-4dd3-4567-a404-d0aa18d059d2,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:05.145585 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8939b024-1b54-4a24-8b3a-fd5d37837cff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.154063 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8939b024-1b54-4a24-8b3a-fd5d37837cff admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.155237 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-8939b024-1b54-4a24-8b3a-fd5d37837cff admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/7b32c1fc-ee6f-42e1-826e-7ed0ac2ad390 HTTP/1.1" status: 204 len: 168 time: 0.1911807 Nov 21 13:53:05.163519 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8939b024-1b54-4a24-8b3a-fd5d37837cff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b32c1fc-ee6f-42e1-826e-7ed0ac2ad390,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:05.484077 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51592) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:05.497077 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-22717e80-c4e3-445d-8b49-76813053bf00 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.577651 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-22717e80-c4e3-445d-8b49-76813053bf00 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.582245 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-22717e80-c4e3-445d-8b49-76813053bf00 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.621816 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-22717e80-c4e3-445d-8b49-76813053bf00 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=04d2a6e330464db382c65cfe9ec8ab83&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1365507 Nov 21 13:53:05.622704 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22717e80-c4e3-445d-8b49-76813053bf00 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=817bbb5f-2b96-4e69-a0ea-a02e952b4980,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:05.624599 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51596) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:05.689505 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d473da4c-602b-45e1-967a-6869810f1519 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.712887 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d473da4c-602b-45e1-967a-6869810f1519 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.759708 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d473da4c-602b-45e1-967a-6869810f1519 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.762289 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d473da4c-602b-45e1-967a-6869810f1519 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:05.763421 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-d473da4c-602b-45e1-967a-6869810f1519 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/817bbb5f-2b96-4e69-a0ea-a02e952b4980 HTTP/1.1" status: 204 len: 168 time: 0.1378453 Nov 21 13:53:05.772065 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d473da4c-602b-45e1-967a-6869810f1519 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=817bbb5f-2b96-4e69-a0ea-a02e952b4980,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:05.828556 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:06.871538 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b62126-470e-4d56-b77e-fbf44a74c342 req-76927a22-4199-4a50-b6f5-267a95c8e8eb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:06.873080 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-97b62126-470e-4d56-b77e-fbf44a74c342 req-76927a22-4199-4a50-b6f5-267a95c8e8eb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0528133 Nov 21 13:53:06.928403 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-97b62126-470e-4d56-b77e-fbf44a74c342 req-033ae1a7-3fb5-449c-997d-ec9099ca7989 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478325 Nov 21 13:53:07.421805 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51706) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:07.579993 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c4f0bcc8-93da-4ca0-a1b2-ff95c784de2e admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:07.663851 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c4f0bcc8-93da-4ca0-a1b2-ff95c784de2e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:07.668282 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c4f0bcc8-93da-4ca0-a1b2-ff95c784de2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:07.712210 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-c4f0bcc8-93da-4ca0-a1b2-ff95c784de2e admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=fcb7f451be9f4629bbd5a51124d52f2a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2868774 Nov 21 13:53:07.712210 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f0bcc8-93da-4ca0-a1b2-ff95c784de2e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=270b7e2a-8e22-4994-a786-3a8dfd81b9c2,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:07.712662 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51722) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:07.792016 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51732) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:07.804241 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f35c6426-d7f8-431c-9a6a-04549bf3c80e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:07.845221 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f35c6426-d7f8-431c-9a6a-04549bf3c80e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:07.915196 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f35c6426-d7f8-431c-9a6a-04549bf3c80e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:07.918133 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f35c6426-d7f8-431c-9a6a-04549bf3c80e admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:07.919321 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-f35c6426-d7f8-431c-9a6a-04549bf3c80e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/270b7e2a-8e22-4994-a786-3a8dfd81b9c2 HTTP/1.1" status: 204 len: 168 time: 0.2055655 Nov 21 13:53:07.928612 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a3e22a80-3f8f-476c-a018-6f6d5ff9c219 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:07.929106 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f35c6426-d7f8-431c-9a6a-04549bf3c80e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=270b7e2a-8e22-4994-a786-3a8dfd81b9c2,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:08.025238 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a3e22a80-3f8f-476c-a018-6f6d5ff9c219 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.033937 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a3e22a80-3f8f-476c-a018-6f6d5ff9c219 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.041117 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51746) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:08.084828 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-a3e22a80-3f8f-476c-a018-6f6d5ff9c219 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=5754a0f83c3e4f11a9409b7d9159b679&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2916911 Nov 21 13:53:08.087424 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51752) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:08.104609 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3e22a80-3f8f-476c-a018-6f6d5ff9c219 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af79ccee-91af-41f5-a9ab-cc50adafabaf,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:08.145953 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-229c7b7c-8bae-44fe-9d0f-0de960323429 req-5d26afc7-a3cb-4612-87b2-32795afa84cc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:08.147494 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-229c7b7c-8bae-44fe-9d0f-0de960323429 req-5d26afc7-a3cb-4612-87b2-32795afa84cc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.1112366 Nov 21 13:53:08.166063 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c6dc7752-9e63-41cf-b3a3-7ced72e7a88b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.193188 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c6dc7752-9e63-41cf-b3a3-7ced72e7a88b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.252674 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-229c7b7c-8bae-44fe-9d0f-0de960323429 req-a223b2b9-3744-4b06-a34c-3eb7fe663009 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0966694 Nov 21 13:53:08.265365 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c6dc7752-9e63-41cf-b3a3-7ced72e7a88b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.268721 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-c6dc7752-9e63-41cf-b3a3-7ced72e7a88b admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.270035 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-c6dc7752-9e63-41cf-b3a3-7ced72e7a88b admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/af79ccee-91af-41f5-a9ab-cc50adafabaf HTTP/1.1" status: 204 len: 168 time: 0.1814444 Nov 21 13:53:08.278740 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6dc7752-9e63-41cf-b3a3-7ced72e7a88b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af79ccee-91af-41f5-a9ab-cc50adafabaf,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:08.317777 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0873a33c-c95b-42fd-b7bf-0226001e9ed2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.386272 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51766) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:08.401323 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0873a33c-c95b-42fd-b7bf-0226001e9ed2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.407044 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0873a33c-c95b-42fd-b7bf-0226001e9ed2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.407168 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4da108d-ff7a-4c54-9eef-208554d2dd2f admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.448929 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0873a33c-c95b-42fd-b7bf-0226001e9ed2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f711f8bf-c149-4415-bab9-b6a6144a75cc,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:08.457473 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-0873a33c-c95b-42fd-b7bf-0226001e9ed2 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=f7360e43a4b947508fc684a7fbf0e7d8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4127283 Nov 21 13:53:08.457790 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51770) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:08.535970 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51772) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:08.536712 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4da108d-ff7a-4c54-9eef-208554d2dd2f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.544972 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4da108d-ff7a-4c54-9eef-208554d2dd2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.731495 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9df559e5-f0d6-45f1-bc18-3ea9624e437a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.754239 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-74859c1a-49a3-4f68-8f06-7f9ed9a789c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.782068 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-c4da108d-ff7a-4c54-9eef-208554d2dd2f admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=332c728c41e7437bbf04bf436e39088a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3945749 Nov 21 13:53:08.782545 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51780) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:08.787335 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4da108d-ff7a-4c54-9eef-208554d2dd2f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c08bc45e-fae1-45df-b703-296cd43f55bb,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:08.792102 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9df559e5-f0d6-45f1-bc18-3ea9624e437a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.844915 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-74859c1a-49a3-4f68-8f06-7f9ed9a789c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.850649 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-74859c1a-49a3-4f68-8f06-7f9ed9a789c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.851798 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51782) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:08.870027 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acfbb5a2-4a6c-48e6-a41b-ea963d182ba6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.893603 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-74859c1a-49a3-4f68-8f06-7f9ed9a789c2 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=560d4e3aca63417f88bce72f1dedcf0a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3558941 Nov 21 13:53:08.894794 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74859c1a-49a3-4f68-8f06-7f9ed9a789c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f88f984d-f311-4221-bef9-0fbbedaf8654,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:08.897662 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9df559e5-f0d6-45f1-bc18-3ea9624e437a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.898068 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51784) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:08.900164 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9df559e5-f0d6-45f1-bc18-3ea9624e437a admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.903617 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-9df559e5-f0d6-45f1-bc18-3ea9624e437a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f711f8bf-c149-4415-bab9-b6a6144a75cc HTTP/1.1" status: 204 len: 168 time: 0.4423828 Nov 21 13:53:08.908782 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5e541300-449f-470a-ae94-d94067560da6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.924978 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9df559e5-f0d6-45f1-bc18-3ea9624e437a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f711f8bf-c149-4415-bab9-b6a6144a75cc,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:08.956451 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5e541300-449f-470a-ae94-d94067560da6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:08.973341 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-42e51535-e27c-40a8-bd44-fd33af40debc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.001172 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-42e51535-e27c-40a8-bd44-fd33af40debc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.033895 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acfbb5a2-4a6c-48e6-a41b-ea963d182ba6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.039223 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acfbb5a2-4a6c-48e6-a41b-ea963d182ba6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.050452 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5e541300-449f-470a-ae94-d94067560da6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.053102 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5e541300-449f-470a-ae94-d94067560da6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.056573 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-5e541300-449f-470a-ae94-d94067560da6 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/c08bc45e-fae1-45df-b703-296cd43f55bb HTTP/1.1" status: 204 len: 168 time: 0.2680571 Nov 21 13:53:09.077875 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-42e51535-e27c-40a8-bd44-fd33af40debc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.080800 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-42e51535-e27c-40a8-bd44-fd33af40debc admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.082078 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-42e51535-e27c-40a8-bd44-fd33af40debc admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f88f984d-f311-4221-bef9-0fbbedaf8654 HTTP/1.1" status: 204 len: 168 time: 0.1829190 Nov 21 13:53:09.087546 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-acfbb5a2-4a6c-48e6-a41b-ea963d182ba6 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=bc2f2f4c2a094b20885cd6da2ebc86d2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2324178 Nov 21 13:53:09.087546 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acfbb5a2-4a6c-48e6-a41b-ea963d182ba6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ca6714d8-4038-44f5-b910-6aca73c4888b,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:09.090028 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51796) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:09.103177 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42e51535-e27c-40a8-bd44-fd33af40debc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f88f984d-f311-4221-bef9-0fbbedaf8654,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:09.129414 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e541300-449f-470a-ae94-d94067560da6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c08bc45e-fae1-45df-b703-296cd43f55bb,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:09.149778 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-aa5cd601-bc2d-4d1c-80b8-5b03c389f9e7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.176519 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-aa5cd601-bc2d-4d1c-80b8-5b03c389f9e7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.231047 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-aa5cd601-bc2d-4d1c-80b8-5b03c389f9e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.233737 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-aa5cd601-bc2d-4d1c-80b8-5b03c389f9e7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.238559 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-aa5cd601-bc2d-4d1c-80b8-5b03c389f9e7 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ca6714d8-4038-44f5-b910-6aca73c4888b HTTP/1.1" status: 204 len: 168 time: 0.1475074 Nov 21 13:53:09.247451 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa5cd601-bc2d-4d1c-80b8-5b03c389f9e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca6714d8-4038-44f5-b910-6aca73c4888b,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:09.606227 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51824) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:09.619674 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3e931d38-f2cb-48e0-a57f-0846e08bd183 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.701791 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3e931d38-f2cb-48e0-a57f-0846e08bd183 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.706796 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3e931d38-f2cb-48e0-a57f-0846e08bd183 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.749638 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e931d38-f2cb-48e0-a57f-0846e08bd183 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d42c3f2-dece-4350-822e-35f2447a3531,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:09.755017 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-3e931d38-f2cb-48e0-a57f-0846e08bd183 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=c7ae9dbf436d42319d88fa4ebc6a9756&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1477511 Nov 21 13:53:09.757985 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51832) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:09.807721 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-229a32a3-f92e-44f6-b2cb-a593d28bbeda admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.832284 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-229a32a3-f92e-44f6-b2cb-a593d28bbeda admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.889822 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-229a32a3-f92e-44f6-b2cb-a593d28bbeda admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.893109 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-229a32a3-f92e-44f6-b2cb-a593d28bbeda admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:09.899605 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-229a32a3-f92e-44f6-b2cb-a593d28bbeda admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/5d42c3f2-dece-4350-822e-35f2447a3531 HTTP/1.1" status: 204 len: 168 time: 0.1349666 Nov 21 13:53:09.908877 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-229a32a3-f92e-44f6-b2cb-a593d28bbeda admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d42c3f2-dece-4350-822e-35f2447a3531,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:10.291938 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51866) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:10.458527 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1100723654-network', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:10.482074 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Made reservation on behalf of 3f91d0ec3fb5421aa1fb95a0cb0d040d for: {'network': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:53:10.484748 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:10.494663 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:10.572187 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:10.576571 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:10.597675 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] vlan segment allocate from pool success with {'vlan_id': 515, 'physical_network': 'physnet1'} {{(pid=109041) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:53:10.613480 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=341ccf65-51a5-469f-80f4-987e02141178,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:10.616375 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:10.616719 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.segments_db [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Added segment 4106bdcf-85b4-49b9-9a69-c6db5fd40e84 of type vlan for network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f Nov 21 13:53:10.660298 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:10.689381 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:10.691326 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:10.692087 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:10.748129 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4542665 Nov 21 13:53:10.748310 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51888) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:10.754490 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-7bc3d4cf-7735-46f4-a04a-44b8d7c38870 admin admin] Request body: {'subnet': {'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1100723654-subnet', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'ip_version': 4}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:10.764153 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bab3de8-6333-4f84-88ca-c214a37300f1 admin admin] Pushing event updated for resources: {'Network': ['ID=0f3bd10b-114c-4dbf-afd6-006b9d81d12f,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:10.773951 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:53:10.787373 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7bc3d4cf-7735-46f4-a04a-44b8d7c38870 admin admin] Made reservation on behalf of 3f91d0ec3fb5421aa1fb95a0cb0d040d for: {'subnet': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:53:10.791267 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7bc3d4cf-7735-46f4-a04a-44b8d7c38870 admin admin] Publish callbacks [] for subnet, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.006994 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7bc3d4cf-7735-46f4-a04a-44b8d7c38870 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for subnet, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.075195 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bc3d4cf-7735-46f4-a04a-44b8d7c38870 admin admin] Pushing event updated for resources: {'Subnet': ['ID=10eb4393-a8dc-4fd9-855e-e410045be9e3,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:11.088109 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bc3d4cf-7735-46f4-a04a-44b8d7c38870 admin admin] Checking segment: {'id': '4106bdcf-85b4-49b9-9a69-c6db5fd40e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109040) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:53:11.088474 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bc3d4cf-7735-46f4-a04a-44b8d7c38870 admin admin] Network hostable DHCP agents. Network: 0f3bd10b-114c-4dbf-afd6-006b9d81d12f, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109040) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:53:11.110005 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bc3d4cf-7735-46f4-a04a-44b8d7c38870 admin admin] Network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109040) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:53:11.117495 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be024f9a-811d-4faa-ade0-6e7017e3293f req-d2c8f670-c1de-4276-b521-815c45038b3f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:11.117495 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-be024f9a-811d-4faa-ade0-6e7017e3293f req-d2c8f670-c1de-4276-b521-815c45038b3f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0598133 Nov 21 13:53:11.133512 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-7bc3d4cf-7735-46f4-a04a-44b8d7c38870 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 0f3bd10b-114c-4dbf-afd6-006b9d81d12f) {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:53:11.143983 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4db8451-8e82-4cbc-a66f-1d911c03329e None None] Network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:53:11.166493 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bc3d4cf-7735-46f4-a04a-44b8d7c38870 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:11.171695 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7bc3d4cf-7735-46f4-a04a-44b8d7c38870 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.188081 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-be024f9a-811d-4faa-ade0-6e7017e3293f req-13cb49b7-5bba-4a27-bdf4-e482dc7c0c32 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548091 Nov 21 13:53:11.194205 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-7bc3d4cf-7735-46f4-a04a-44b8d7c38870 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.4448681 Nov 21 13:53:11.197049 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 51912) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:11.202473 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:11.228122 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-408660', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-58304'] for router, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.229728 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-473172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-468334', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1610115', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-58419'] for router, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.303297 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.368236 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6b3ed262-49ce-5e18-b10a-0ddd25bea067-0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'fixed_ips': [{'subnet_id': '10eb4393-a8dc-4fd9-855e-e410045be9e3'}]}} from dv-cinder-768458-12-iscsi. {{(pid=109042) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 21 13:53:11.369614 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.507258 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51922) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:11.545235 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.db_base_plugin_common [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Allocated IP 172.20.0.2 (0f3bd10b-114c-4dbf-afd6-006b9d81d12f/10eb4393-a8dc-4fd9-855e-e410045be9e3/b68fb0d4-2758-482a-8e42-7051d5917f69) {{(pid=109042) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:53:11.692369 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.723669 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-dec14ade-53c3-4a62-86b0-7f57f86a4dc6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.734648 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Publish callbacks [] for port, precommit_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.744462 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.807334 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f is already hosted by enough agents. {{(pid=109042) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:53:11.811413 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.base_scheduler [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Resources bound (agent type, host, resource id): {{(pid=109042) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:53:11.819615 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Received port after_create {{(pid=109042) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:53:11.828241 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-dec14ade-53c3-4a62-86b0-7f57f86a4dc6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.837024 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-dec14ade-53c3-4a62-86b0-7f57f86a4dc6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.849013 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Pushing event updated for resources: {'Port': ['ID=b68fb0d4-2758-482a-8e42-7051d5917f69,revision_number=1']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:11.895946 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:11.896390 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:11.896712 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:11.897062 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:11.897398 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:11.897750 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:11.902785 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:11.903197 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:11.903569 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:11.903976 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:11.904321 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:11.904651 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:11.923143 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Attempting to bind port b68fb0d4-2758-482a-8e42-7051d5917f69 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:53:11.923672 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Attempting to bind port b68fb0d4-2758-482a-8e42-7051d5917f69 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '4106bdcf-85b4-49b9-9a69-c6db5fd40e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:53:11.924907 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Attempting to bind port b68fb0d4-2758-482a-8e42-7051d5917f69 on network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:53:11.925752 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-dec14ade-53c3-4a62-86b0-7f57f86a4dc6 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=345f5533e1594405b182bf86738a0d25&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4171960 Nov 21 13:53:11.926601 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 51940) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:11.934908 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dec14ade-53c3-4a62-86b0-7f57f86a4dc6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c4abc71c-eb31-48dd-9333-aee93fbcf072,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:11.947481 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 53, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:53:11.948019 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Checking segment: {'id': '4106bdcf-85b4-49b9-9a69-c6db5fd40e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:53:11.948434 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:11.948833 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Bound using segment: {'id': '4106bdcf-85b4-49b9-9a69-c6db5fd40e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:53:11.949337 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Bound port: b68fb0d4-2758-482a-8e42-7051d5917f69, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4106bdcf-85b4-49b9-9a69-c6db5fd40e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:53:11.949723 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:12.009165 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-231d38df-fdbf-4507-a97f-9c7a085cb24e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:12.051574 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-231d38df-fdbf-4507-a97f-9c7a085cb24e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:12.113727 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:12.118947 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] For port b68fb0d4-2758-482a-8e42-7051d5917f69, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:53:12.124028 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] For port b68fb0d4-2758-482a-8e42-7051d5917f69, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=b68fb0d4-2758-482a-8e42-7051d5917f69,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:53:12.136559 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:12.146375 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:12.177079 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-231d38df-fdbf-4507-a97f-9c7a085cb24e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:12.181847 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-231d38df-fdbf-4507-a97f-9c7a085cb24e admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:12.187036 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-231d38df-fdbf-4507-a97f-9c7a085cb24e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/c4abc71c-eb31-48dd-9333-aee93fbcf072 HTTP/1.1" status: 204 len: 168 time: 0.2592607 Nov 21 13:53:12.207603 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-231d38df-fdbf-4507-a97f-9c7a085cb24e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c4abc71c-eb31-48dd-9333-aee93fbcf072,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:12.259243 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d5b506-8dfd-4dcd-ae22-fd02ec592e38 None None] Pushing event updated for resources: {'Port': ['ID=b68fb0d4-2758-482a-8e42-7051d5917f69,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:12.366540 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Allocated IP 172.27.1.98 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/7a2f37a4-fa1b-4b98-a9da-cdcaff390f92) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:53:12.429991 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-490a17e4-5b5a-472f-be9a-d554778d4c55 req-95454242-893d-4dfb-a037-053fa17cddbd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:12.437472 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-490a17e4-5b5a-472f-be9a-d554778d4c55 req-95454242-893d-4dfb-a037-053fa17cddbd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.1118279 Nov 21 13:53:12.516639 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-490a17e4-5b5a-472f-be9a-d554778d4c55 req-eea917b1-d684-4b63-94c7-0216c2d733fa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0781584 Nov 21 13:53:12.560076 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:12.618537 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:12.669588 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:53:12.672800 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:53:12.676447 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:53:12.706151 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Pushing event updated for resources: {'Port': ['ID=7a2f37a4-fa1b-4b98-a9da-cdcaff390f92,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:13.026459 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:13.342787 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-473263', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-468275'] for router, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:13.481487 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Router bec884cd-90a7-4717-a897-0e3e2c2c310b is scheduled to L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 with binding_index 1 {{(pid=109041) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 21 13:53:13.601323 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:53:13.613584 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Sync routers for ids ['bec884cd-90a7-4717-a897-0e3e2c2c310b'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:53:13.625325 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Routers {'bec884cd-90a7-4717-a897-0e3e2c2c310b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:53:13.627197 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:53:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['bec884cd-90a7-4717-a897-0e3e2c2c310b'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:13.635385 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] Publish callbacks [] for router, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:13.635385 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-fea4de5f-06ae-400e-8e94-56cff687b4da admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.4335043 Nov 21 13:53:13.635889 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52034) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:13.646380 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ee63f2d-8b23-4537-859a-ef6d2d3339ce None None] Network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:53:13.719928 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-d5f16cb5-3f87-4b71-be01-fb7535db2ecf None None] Provisioning complete for port b68fb0d4-2758-482a-8e42-7051d5917f69 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:13.720296 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d5f16cb5-3f87-4b71-be01-fb7535db2ecf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:13.725011 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 52042) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:13.756828 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Set router bec884cd-90a7-4717-a897-0e3e2c2c310b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:53:13.944978 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d5f16cb5-3f87-4b71-be01-fb7535db2ecf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:13.958282 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98'}], 'enable_snat': True}, 'gw_port_id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:53:12Z', 'revision_number': 3, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port': {'id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:45:d9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:12Z', 'updated_at': '2021-11-21T13:53:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:13.983207 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4ad94e68-0fca-4d48-8f1e-fd94a76e3728 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:13.990330 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Checking router: bec884cd-90a7-4717-a897-0e3e2c2c310b for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:53:13.990330 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Updating router bec884cd-90a7-4717-a897-0e3e2c2c310b port 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92 binding host dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:53:14.025402 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.063654 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-d5f16cb5-3f87-4b71-be01-fb7535db2ecf None None] For port b68fb0d4-2758-482a-8e42-7051d5917f69, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=b68fb0d4-2758-482a-8e42-7051d5917f69,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:53:14.078088 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d5f16cb5-3f87-4b71-be01-fb7535db2ecf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.152354 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4ad94e68-0fca-4d48-8f1e-fd94a76e3728 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.159393 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4ad94e68-0fca-4d48-8f1e-fd94a76e3728 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.207931 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5f16cb5-3f87-4b71-be01-fb7535db2ecf None None] Pushing event updated for resources: {'Port': ['ID=b68fb0d4-2758-482a-8e42-7051d5917f69,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:14.270488 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-4ad94e68-0fca-4d48-8f1e-fd94a76e3728 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=daeec6eb15174865bb3613039ce44c7a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5441937 Nov 21 13:53:14.280277 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 52080) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:14.332737 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.342347 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device b68fb0d4-2758-482a-8e42-7051d5917f69 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:53:14.363566 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ad94e68-0fca-4d48-8f1e-fd94a76e3728 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e850a4fa-777b-4c22-bbca-111de7482aa1,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:14.440648 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-37a594f2-a7f1-4add-97a2-d768365221b3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.459779 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port b68fb0d4-2758-482a-8e42-7051d5917f69 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:14.460178 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.467533 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-37a594f2-a7f1-4add-97a2-d768365221b3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.523082 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-f51adb28-3114-41fa-ac0f-dbcc79ceb345 None None] Provisioning complete for port b68fb0d4-2758-482a-8e42-7051d5917f69 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:14.523593 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-f51adb28-3114-41fa-ac0f-dbcc79ceb345 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.527878 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-37a594f2-a7f1-4add-97a2-d768365221b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.531501 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-37a594f2-a7f1-4add-97a2-d768365221b3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.532973 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-37a594f2-a7f1-4add-97a2-d768365221b3 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/e850a4fa-777b-4c22-bbca-111de7482aa1 HTTP/1.1" status: 204 len: 168 time: 0.2340806 Nov 21 13:53:14.543349 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37a594f2-a7f1-4add-97a2-d768365221b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e850a4fa-777b-4c22-bbca-111de7482aa1,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:14.560151 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Allocated IP 172.20.0.1 (0f3bd10b-114c-4dbf-afd6-006b9d81d12f/10eb4393-a8dc-4fd9-855e-e410045be9e3/8e41a24c-4ee3-43e7-88e0-f250d096d06f) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:53:14.581371 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Publish callbacks [] for port, precommit_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.588140 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.652915 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Pushing event updated for resources: {'Port': ['ID=7a2f37a4-fa1b-4b98-a9da-cdcaff390f92,revision_number=2']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:14.672516 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:14.673623 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:14.674112 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:14.674550 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:14.674963 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:14.675379 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:14.675841 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:14.678015 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:14.678472 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:14.678915 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:14.679359 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:14.679885 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:14.685803 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Attempting to bind port 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:53:14.686389 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Attempting to bind port 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:53:14.686913 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Attempting to bind port 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92 on network 67069811-a3d5-4953-8a57-e62d44750fe3 {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:53:14.693647 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 53, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:53:14.694225 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Checking segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109043) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:53:14.694621 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.695007 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Bound using segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:53:14.695473 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Bound port: 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:53:14.695880 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.701068 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.735209 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.754531 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] For port 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109043) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:53:14.758122 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] For port 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=7a2f37a4-fa1b-4b98-a9da-cdcaff390f92,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109043) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:53:14.762366 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.780240 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:53:14.784718 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:53:14.789240 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:53:14.789651 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-470894'] for router_interface, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.793757 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Pushing event updated for resources: {'Port': ['ID=8e41a24c-4ee3-43e7-88e0-f250d096d06f,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:14.818250 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Routers {'bec884cd-90a7-4717-a897-0e3e2c2c310b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:53:14.818877 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:53:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['bec884cd-90a7-4717-a897-0e3e2c2c310b'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:14.856282 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0a88fc3-8ab8-4496-a108-b0bf90448e79 None None] Pushing event updated for resources: {'Port': ['ID=7a2f37a4-fa1b-4b98-a9da-cdcaff390f92,revision_number=3']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:14.902811 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 52092) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:14.919303 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7ceeb9af-fc1f-4618-9b00-27704165f0ef admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:14.944635 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] Set router bec884cd-90a7-4717-a897-0e3e2c2c310b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:53:14.970628 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:15.027514 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7ceeb9af-fc1f-4618-9b00-27704165f0ef admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:15.036724 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7ceeb9af-fc1f-4618-9b00-27704165f0ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:15.074544 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-7ceeb9af-fc1f-4618-9b00-27704165f0ef admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=056f480def274623bbc4b8cd6a69fec6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1682799 Nov 21 13:53:15.075009 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52094) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:15.085626 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ceeb9af-fc1f-4618-9b00-27704165f0ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=70097454-7518-4387-9c8a-a84acefd2483,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:15.101737 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-23d0ec0e-ad27-4199-9b4a-0d8ec1791bc9 None None] Provisioning complete for port 8e41a24c-4ee3-43e7-88e0-f250d096d06f triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:15.102243 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-23d0ec0e-ad27-4199-9b4a-0d8ec1791bc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:15.137533 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-23d0ec0e-ad27-4199-9b4a-0d8ec1791bc9 None None] Port 8e41a24c-4ee3-43e7-88e0-f250d096d06f cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:53:15.158762 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9826ee57-248d-49a4-8ad2-a84f32be8a2a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:15.194470 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9826ee57-248d-49a4-8ad2-a84f32be8a2a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:15.208684 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:15.218234 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:15.218934 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1684480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-473342'] for router_interface, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:15.251737 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98'}], 'enable_snat': True}, 'gw_port_id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:53:12Z', 'revision_number': 3, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port': {'id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:45:d9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:12Z', 'updated_at': '2021-11-21T13:53:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:15.304708 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7fb3f56-d564-4a4d-ac43-e063c47d5e97 None None] The sync data for ids ['bec884cd-90a7-4717-a897-0e3e2c2c310b'] in dv-cinder-768458-12-iscsi is: [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98'}], 'enable_snat': True}, 'gw_port_id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:53:12Z', 'revision_number': 3, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port': {'id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:45:d9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:12Z', 'updated_at': '2021-11-21T13:53:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:53:15.329018 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Pushing event updated for resources: {'Port': ['ID=8e41a24c-4ee3-43e7-88e0-f250d096d06f,revision_number=2']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:15.346809 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9826ee57-248d-49a4-8ad2-a84f32be8a2a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:15.351367 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9826ee57-248d-49a4-8ad2-a84f32be8a2a admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:15.352859 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-9826ee57-248d-49a4-8ad2-a84f32be8a2a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/70097454-7518-4387-9c8a-a84acefd2483 HTTP/1.1" status: 204 len: 168 time: 0.2766280 Nov 21 13:53:15.373264 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9826ee57-248d-49a4-8ad2-a84f32be8a2a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70097454-7518-4387-9c8a-a84acefd2483,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:15.404937 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:53:15.406545 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:53:15.456715 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd56a059-860c-4fbc-9d22-a93961d9c385 req-834ba0b2-b8d0-45ad-9b93-5a9a890181f3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:15.466578 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fd56a059-860c-4fbc-9d22-a93961d9c385 req-834ba0b2-b8d0-45ad-9b93-5a9a890181f3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.1098542 Nov 21 13:53:15.561744 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fd56a059-860c-4fbc-9d22-a93961d9c385 req-c3ef9e26-d46c-41d5-9939-f9ae3c286b77 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0933309 Nov 21 13:53:15.591397 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Router bec884cd-90a7-4717-a897-0e3e2c2c310b has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:53:15.775993 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-d83557b4-e538-4b85-9625-afc85b926bd1 None None] Provisioning complete for port 8e41a24c-4ee3-43e7-88e0-f250d096d06f triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:15.777217 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d83557b4-e538-4b85-9625-afc85b926bd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:15.804698 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:53:15.821308 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-60af2f65-e1aa-4d04-984d-72a68c704eba admin admin] 10.222.0.11 "PUT /v2.0/routers/bec884cd-90a7-4717-a897-0e3e2c2c310b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1860747 Nov 21 13:53:15.851419 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-d83557b4-e538-4b85-9625-afc85b926bd1 None None] Port 8e41a24c-4ee3-43e7-88e0-f250d096d06f cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:53:16.344235 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:53:16.509528 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:16.510145 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:16.698668 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:16.721728 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=7a2f37a4-fa1b-4b98-a9da-cdcaff390f92,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:53:16.727130 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:16.728680 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device b68fb0d4-2758-482a-8e42-7051d5917f69 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:53:16.766032 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16efd947-eb12-4771-823a-fb2ae7c04f72 req-d3606b12-bd46-4735-a397-2bb78ccd0ccb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:16.772505 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 52192) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:16.800732 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-664246061-network', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:16.804657 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-16efd947-eb12-4771-823a-fb2ae7c04f72 req-d3606b12-bd46-4735-a397-2bb78ccd0ccb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.1245148 Nov 21 13:53:16.830640 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=7a2f37a4-fa1b-4b98-a9da-cdcaff390f92,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:16.835742 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port b68fb0d4-2758-482a-8e42-7051d5917f69 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:16.836659 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:16.851077 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Made reservation on behalf of f4b2e564a45b45dd8e98fd102ec65206 for: {'network': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:53:16.855086 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:16.872282 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:16.921610 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-16efd947-eb12-4771-823a-fb2ae7c04f72 req-f1a3bcf9-959c-452f-b093-60e54ffdf9f7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1151314 Nov 21 13:53:17.003453 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:17.009123 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:17.032635 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] vlan segment allocate from pool success with {'vlan_id': 503, 'physical_network': 'physnet1'} {{(pid=109041) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:53:17.056588 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef10eb9f-adfc-4b73-b6a3-753eb02e3787,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:17.069400 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:17.069750 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.segments_db [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Added segment 5c66054f-77db-4a85-9c38-fb8c59887e07 of type vlan for network 25ab6676-6dc6-4d22-bb7c-bd53e740870d Nov 21 13:53:17.141522 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:17.177837 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:17.178907 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:17.179584 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:17.257283 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.4808655 Nov 21 13:53:17.261992 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 52196) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:17.269332 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-3ab3129b-b3ba-4a55-af98-5bd746577770 admin admin] Request body: {'subnet': {'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-664246061-subnet', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:17.312684 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aab69293-20b2-4448-aa13-edf414c81c56 admin admin] Pushing event updated for resources: {'Network': ['ID=25ab6676-6dc6-4d22-bb7c-bd53e740870d,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:17.337853 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 25ab6676-6dc6-4d22-bb7c-bd53e740870d details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:53:17.345420 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ab3129b-b3ba-4a55-af98-5bd746577770 admin admin] Made reservation on behalf of f4b2e564a45b45dd8e98fd102ec65206 for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:53:17.348285 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3ab3129b-b3ba-4a55-af98-5bd746577770 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-261005224'] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:17.597907 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3ab3129b-b3ba-4a55-af98-5bd746577770 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3086915', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-261005206'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:17.691474 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ab3129b-b3ba-4a55-af98-5bd746577770 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6f8e95bb-7134-4b19-812b-ae4abd04687c,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:17.696769 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ab3129b-b3ba-4a55-af98-5bd746577770 admin admin] Checking segment: {'id': '5c66054f-77db-4a85-9c38-fb8c59887e07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:53:17.697053 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ab3129b-b3ba-4a55-af98-5bd746577770 admin admin] Network hostable DHCP agents. Network: 25ab6676-6dc6-4d22-bb7c-bd53e740870d, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:53:17.729131 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ab3129b-b3ba-4a55-af98-5bd746577770 admin admin] Network 25ab6676-6dc6-4d22-bb7c-bd53e740870d is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:53:17.738007 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Sync routers for ids ['bec884cd-90a7-4717-a897-0e3e2c2c310b'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:53:17.750898 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-3ab3129b-b3ba-4a55-af98-5bd746577770 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 25ab6676-6dc6-4d22-bb7c-bd53e740870d) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:53:17.753469 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Routers {'bec884cd-90a7-4717-a897-0e3e2c2c310b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:53:17.754102 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:53:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['bec884cd-90a7-4717-a897-0e3e2c2c310b'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:17.763040 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ab3129b-b3ba-4a55-af98-5bd746577770 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:17.763660 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3ab3129b-b3ba-4a55-af98-5bd746577770 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:17.786932 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-3ab3129b-b3ba-4a55-af98-5bd746577770 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.5240438 Nov 21 13:53:17.789499 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52230) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:17.790618 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-813c5d4d-9c3c-4eac-8ad1-e37c374a5da6 None None] Network 25ab6676-6dc6-4d22-bb7c-bd53e740870d requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:53:17.794911 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-664246061-router', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:17.822474 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-408660', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-58304'] for router, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:17.823770 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-473172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-468334', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1610115', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-58419'] for router, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:17.948360 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:18.078239 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b4faa6a-2c55-448a-8622-4d54bd7330cf req-fb5c5075-8ed5-42b8-a341-333200e0c2d1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:18.089124 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8b4faa6a-2c55-448a-8622-4d54bd7330cf req-fb5c5075-8ed5-42b8-a341-333200e0c2d1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0747697 Nov 21 13:53:18.124616 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Set router bec884cd-90a7-4717-a897-0e3e2c2c310b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:53:18.149813 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8b4faa6a-2c55-448a-8622-4d54bd7330cf req-cd7a5818-a854-4c3a-b72f-12d0fb9ff7a4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0586183 Nov 21 13:53:18.262705 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:53:18.394024 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:18.424134 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6b3ed262-49ce-5e18-b10a-0ddd25bea067-25ab6676-6dc6-4d22-bb7c-bd53e740870d', 'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'fixed_ips': [{'subnet_id': '6f8e95bb-7134-4b19-812b-ae4abd04687c'}]}} from dv-cinder-768458-12-iscsi. {{(pid=109042) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 21 13:53:18.424994 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:18.462466 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:18.462839 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:18.642472 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-c40ef285-97c5-4011-b5b4-305c3aa1d62f tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/networks?tenant_id=9fec3a1c72184d41a6e85ec8ece002db&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0332987 Nov 21 13:53:18.671636 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:18.700397 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.db_base_plugin_common [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Allocated IP 172.20.0.2 (25ab6676-6dc6-4d22-bb7c-bd53e740870d/6f8e95bb-7134-4b19-812b-ae4abd04687c/c9a4cdd6-e0fd-4e22-8872-e12b30fb970d) {{(pid=109042) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:53:18.703651 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98'}], 'enable_snat': True}, 'gw_port_id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:53:14Z', 'revision_number': 4, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port': {'id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:45:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:12Z', 'updated_at': '2021-11-21T13:53:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '8e41a24c-4ee3-43e7-88e0-f250d096d06f', 'name': '', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'mac_address': 'fa:16:3e:d0:dd:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_interface', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:14Z', 'updated_at': '2021-11-21T13:53:15Z', 'revision_number': 2, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'subnets': [{'id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:18.750242 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:18.757840 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Checking router: bec884cd-90a7-4717-a897-0e3e2c2c310b for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:53:18.758387 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Updating router bec884cd-90a7-4717-a897-0e3e2c2c310b port 8e41a24c-4ee3-43e7-88e0-f250d096d06f binding host dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:53:18.828570 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:18.953742 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-623cd8a9-ad28-4df9-88d8-488502efaf3f tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:18.955695 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-623cd8a9-ad28-4df9-88d8-488502efaf3f tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3047574 Nov 21 13:53:18.981586 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-8a549a94-e952-4df5-94f8-42cc071a2364 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/quotas/9fec3a1c72184d41a6e85ec8ece002db HTTP/1.1" status: 200 len: 375 time: 0.0198004 Nov 21 13:53:18.993573 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Allocated IP 172.27.1.30 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:53:19.040871 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-fe27410e-b922-4d8e-a866-dd8c2cbb3ad8 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=9fec3a1c72184d41a6e85ec8ece002db&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0491307 Nov 21 13:53:19.103361 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Publish callbacks [] for port, precommit_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:19.116516 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:19.175593 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Network 25ab6676-6dc6-4d22-bb7c-bd53e740870d is already hosted by enough agents. {{(pid=109042) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:53:19.186412 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.base_scheduler [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Resources bound (agent type, host, resource id): {{(pid=109042) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:53:19.190334 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Received port after_create {{(pid=109042) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:53:19.216759 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Pushing event updated for resources: {'Port': ['ID=c9a4cdd6-e0fd-4e22-8872-e12b30fb970d,revision_number=1']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:19.243668 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:19.277578 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4ec60add-f487-4248-adf3-e713d3264035 req-e1504d20-8eb8-44fc-8cda-188d2ee71ec4 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 210 time: 0.0721614 Nov 21 13:53:19.330321 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Attempting to bind port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:53:19.330777 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Attempting to bind port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '5c66054f-77db-4a85-9c38-fb8c59887e07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:53:19.331097 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Attempting to bind port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d on network 25ab6676-6dc6-4d22-bb7c-bd53e740870d {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:53:19.340680 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 53, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:53:19.340900 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Checking segment: {'id': '5c66054f-77db-4a85-9c38-fb8c59887e07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:53:19.341424 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:19.341829 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Bound using segment: {'id': '5c66054f-77db-4a85-9c38-fb8c59887e07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:53:19.342360 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Bound port: c9a4cdd6-e0fd-4e22-8872-e12b30fb970d, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c66054f-77db-4a85-9c38-fb8c59887e07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:53:19.342713 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:19.360808 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Publish callbacks [] for port, precommit_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:19.371053 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:19.374222 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1285d768-5404-42eb-8f00-4f48680eaef1 req-4f4868bf-237d-4775-81bd-f77b3fa20ca9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:19.376139 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1285d768-5404-42eb-8f00-4f48680eaef1 req-4f4868bf-237d-4775-81bd-f77b3fa20ca9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0785625 Nov 21 13:53:19.381090 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:19.491623 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:53:19.492908 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Pushing event updated for resources: {'Port': ['ID=f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:19.500264 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:53:19.509065 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:53:19.535868 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] For port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:53:19.542376 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] For port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=c9a4cdd6-e0fd-4e22-8872-e12b30fb970d,segment=NetworkSegment(5c66054f-77db-4a85-9c38-fb8c59887e07),segment_id=5c66054f-77db-4a85-9c38-fb8c59887e07)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:53:19.559645 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-660a1589-285b-440c-aefb-add5c176f3b5 None None] Pushing event updated for resources: {'Port': ['ID=8e41a24c-4ee3-43e7-88e0-f250d096d06f,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:19.608920 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:19.616849 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1285d768-5404-42eb-8f00-4f48680eaef1 req-a746a72a-bd92-44a0-a242-a929e07973de tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2332101 Nov 21 13:53:19.737523 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Attempting to bind port 8e41a24c-4ee3-43e7-88e0-f250d096d06f on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:53:19.738233 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Attempting to bind port 8e41a24c-4ee3-43e7-88e0-f250d096d06f by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '4106bdcf-85b4-49b9-9a69-c6db5fd40e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:53:19.738606 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Attempting to bind port 8e41a24c-4ee3-43e7-88e0-f250d096d06f on network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:53:19.778059 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 53, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:53:19.778658 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Checking segment: {'id': '4106bdcf-85b4-49b9-9a69-c6db5fd40e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:53:19.778889 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:19.779295 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Bound using segment: {'id': '4106bdcf-85b4-49b9-9a69-c6db5fd40e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:53:19.779817 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Bound port: 8e41a24c-4ee3-43e7-88e0-f250d096d06f, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4106bdcf-85b4-49b9-9a69-c6db5fd40e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:53:19.780216 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:19.830851 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d83af5d-8e96-4a0a-a732-1e494919b396 None None] Pushing event updated for resources: {'Port': ['ID=c9a4cdd6-e0fd-4e22-8872-e12b30fb970d,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:19.848842 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-e365d373-cb28-4cbb-8746-729300de4e4f None None] Provisioning complete for port 8e41a24c-4ee3-43e7-88e0-f250d096d06f triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:19.849227 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e365d373-cb28-4cbb-8746-729300de4e4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:19.864792 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:19.976956 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-e365d373-cb28-4cbb-8746-729300de4e4f None None] Port 8e41a24c-4ee3-43e7-88e0-f250d096d06f cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:53:20.004029 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] For port 8e41a24c-4ee3-43e7-88e0-f250d096d06f, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:53:20.009016 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] For port 8e41a24c-4ee3-43e7-88e0-f250d096d06f, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=8e41a24c-4ee3-43e7-88e0-f250d096d06f,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:53:20.018534 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:20.176610 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Routers {'bec884cd-90a7-4717-a897-0e3e2c2c310b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:53:20.178826 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:53:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['bec884cd-90a7-4717-a897-0e3e2c2c310b'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:20.294998 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-473263', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-468275'] for router, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:20.457642 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d3c8eccf-8eea-49e4-b823-7c74f433b119 req-a018617d-aeea-4e7d-ac18-d00b8c5f52fd tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 210 time: 0.0351317 Nov 21 13:53:20.483962 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device c9a4cdd6-e0fd-4e22-8872-e12b30fb970d up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:53:20.490455 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Router 93e91779-c8b9-44c0-97bb-b1f2a757239c is scheduled to L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 with binding_index 1 {{(pid=109040) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 21 13:53:20.531508 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-660a1589-285b-440c-aefb-add5c176f3b5 None None] Pushing event updated for resources: {'Port': ['ID=8e41a24c-4ee3-43e7-88e0-f250d096d06f,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:20.592321 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-3a699d45-ca17-4051-951e-cbed527dec78 None None] Provisioning complete for port 8e41a24c-4ee3-43e7-88e0-f250d096d06f triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:20.592708 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-3a699d45-ca17-4051-951e-cbed527dec78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:20.612181 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:53:20.637267 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] Publish callbacks [] for router, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:20.643858 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-fc1283e8-de96-4fd8-bb5c-b125aced623b admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.8521588 Nov 21 13:53:20.648423 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 52312) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:20.650728 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Sync routers for ids ['93e91779-c8b9-44c0-97bb-b1f2a757239c'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:53:20.662467 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] Set router bec884cd-90a7-4717-a897-0e3e2c2c310b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:53:20.671785 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Routers {'93e91779-c8b9-44c0-97bb-b1f2a757239c'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:53:20.678270 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-85979494-901b-4ee2-83db-48b087acee67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:53:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['93e91779-c8b9-44c0-97bb-b1f2a757239c'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:20.694093 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:20.694462 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:20.776070 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-bc0aac1c-16aa-42f7-856f-5818f8ef411f tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.50 "GET /v2.0/networks?tenant_id=9fec3a1c72184d41a6e85ec8ece002db&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0514193 Nov 21 13:53:20.810337 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd7a0f6-6ebf-48ee-bed7-46ed829e1e5f req-cc58e02d-30c6-4057-ba29-f370158fc56f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:20.819071 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0bd7a0f6-6ebf-48ee-bed7-46ed829e1e5f req-cc58e02d-30c6-4057-ba29-f370158fc56f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0696149 Nov 21 13:53:20.861751 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Set router 93e91779-c8b9-44c0-97bb-b1f2a757239c gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:53:20.918562 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0bd7a0f6-6ebf-48ee-bed7-46ed829e1e5f req-85db5531-7dd0-4f47-85fa-da3d12e8ee73 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0961876 Nov 21 13:53:21.058871 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-3a699d45-ca17-4051-951e-cbed527dec78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:21.084358 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-85979494-901b-4ee2-83db-48b087acee67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'name': 'tempest-TestShelveInstance-664246061-router', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30'}], 'enable_snat': True}, 'gw_port_id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:17Z', 'updated_at': '2021-11-21T13:53:19Z', 'revision_number': 3, 'project_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'gw_port': {'id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:b0:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:18Z', 'updated_at': '2021-11-21T13:53:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:21.117177 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Checking router: 93e91779-c8b9-44c0-97bb-b1f2a757239c for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:53:21.117643 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Updating router 93e91779-c8b9-44c0-97bb-b1f2a757239c port f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f binding host dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:53:21.148904 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:21.175829 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:21.200853 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-3a699d45-ca17-4051-951e-cbed527dec78 None None] For port 8e41a24c-4ee3-43e7-88e0-f250d096d06f, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=8e41a24c-4ee3-43e7-88e0-f250d096d06f,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:53:21.214583 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-3a699d45-ca17-4051-951e-cbed527dec78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:21.304528 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=c9a4cdd6-e0fd-4e22-8872-e12b30fb970d,segment=NetworkSegment(5c66054f-77db-4a85-9c38-fb8c59887e07),segment_id=5c66054f-77db-4a85-9c38-fb8c59887e07)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:53:21.330541 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:21.376228 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a699d45-ca17-4051-951e-cbed527dec78 None None] Pushing event updated for resources: {'Port': ['ID=8e41a24c-4ee3-43e7-88e0-f250d096d06f,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:21.425021 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c35b656-5f91-4cea-84c5-19f1804a993a None None] Network 25ab6676-6dc6-4d22-bb7c-bd53e740870d requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:53:21.438238 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98'}], 'enable_snat': True}, 'gw_port_id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:53:14Z', 'revision_number': 4, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port': {'id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:45:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:12Z', 'updated_at': '2021-11-21T13:53:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '8e41a24c-4ee3-43e7-88e0-f250d096d06f', 'name': '', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'mac_address': 'fa:16:3e:d0:dd:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_interface', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:14Z', 'updated_at': '2021-11-21T13:53:19Z', 'revision_number': 4, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'subnets': [{'id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:21.551420 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-9d4d3722-0c93-4485-9475-bbd5187115f3 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:21.552902 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-9d4d3722-0c93-4485-9475-bbd5187115f3 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.50 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.7595599 Nov 21 13:53:21.571444 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Request body: {'port': {'device_id': 'a010f06f-1270-458b-a306-5e93a074e67a', 'network_id': 'c04e4031-26f3-476a-92dc-8476ff89cbca', 'admin_state_up': True, 'tenant_id': '9fec3a1c72184d41a6e85ec8ece002db'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:21.577471 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b759d936-a682-4653-b5e6-cffc753dbd22 None None] The sync data for ids ['bec884cd-90a7-4717-a897-0e3e2c2c310b'] in dv-cinder-768458-12-iscsi is: [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98'}], 'enable_snat': True}, 'gw_port_id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:53:14Z', 'revision_number': 4, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port': {'id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:45:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:12Z', 'updated_at': '2021-11-21T13:53:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '8e41a24c-4ee3-43e7-88e0-f250d096d06f', 'name': '', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'mac_address': 'fa:16:3e:d0:dd:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_interface', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:14Z', 'updated_at': '2021-11-21T13:53:19Z', 'revision_number': 4, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'subnets': [{'id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:53:21.608221 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=c9a4cdd6-e0fd-4e22-8872-e12b30fb970d,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:21.656175 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-3f33c478-993f-437c-8d0c-95b8b8c6dce0 None None] Provisioning complete for port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:21.656175 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-3f33c478-993f-437c-8d0c-95b8b8c6dce0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:21.681195 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Publish callbacks [] for port, precommit_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:21.689255 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:21.763609 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86159f20-7ceb-4999-8e4d-2588de1264e6 None None] Pushing event updated for resources: {'Port': ['ID=f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f,revision_number=2']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:21.831134 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Attempting to bind port f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:53:21.833245 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Attempting to bind port f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:53:21.834081 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Attempting to bind port f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f on network 67069811-a3d5-4953-8a57-e62d44750fe3 {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:53:21.843376 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 53, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:53:21.844329 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Checking segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109043) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:53:21.844891 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:21.845526 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Bound using segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:53:21.846396 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Bound port: f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:53:21.846960 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:21.848659 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-beae2396-a950-43ce-b493-6f54f11d61ef req-74171d92-d458-410d-a845-618c48e7d137 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 210 time: 0.2227786 Nov 21 13:53:22.016164 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Made reservation on behalf of 9fec3a1c72184d41a6e85ec8ece002db for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:53:22.017080 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-85979494-901b-4ee2-83db-48b087acee67 None None] For port f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109043) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:53:22.021926 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:22.030002 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-85979494-901b-4ee2-83db-48b087acee67 None None] For port f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109043) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:53:22.039065 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:22.039276 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:22.078676 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1cdeb82-bb6c-49e2-b092-a86353da8a92 req-c65d44cf-b522-48d2-86f1-31a82949ea44 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:22.080281 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b1cdeb82-bb6c-49e2-b092-a86353da8a92 req-c65d44cf-b522-48d2-86f1-31a82949ea44 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0749915 Nov 21 13:53:22.201028 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Routers {'93e91779-c8b9-44c0-97bb-b1f2a757239c'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:53:22.201659 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-85979494-901b-4ee2-83db-48b087acee67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:53:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['93e91779-c8b9-44c0-97bb-b1f2a757239c'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:22.215167 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b1cdeb82-bb6c-49e2-b092-a86353da8a92 req-dc260be5-fb39-4a08-b012-8eb8debf4c23 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1224637 Nov 21 13:53:22.218615 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86159f20-7ceb-4999-8e4d-2588de1264e6 None None] Pushing event updated for resources: {'Port': ['ID=f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f,revision_number=3']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:22.370114 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:22.401961 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:22.420479 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-42f45f78-c09a-443f-88b6-fc5a7f772f98 None None] Provisioning complete for port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:22.421042 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-42f45f78-c09a-443f-88b6-fc5a7f772f98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:22.428222 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-85979494-901b-4ee2-83db-48b087acee67 None None] Set router 93e91779-c8b9-44c0-97bb-b1f2a757239c gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:53:22.482561 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device c9a4cdd6-e0fd-4e22-8872-e12b30fb970d up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:53:22.505304 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3d079ed7-d436-4575-97d3-7328e3a65595,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:22.509349 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:22.583702 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:22.647274 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:22.647646 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:22.743958 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-85979494-901b-4ee2-83db-48b087acee67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'name': 'tempest-TestShelveInstance-664246061-router', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30'}], 'enable_snat': True}, 'gw_port_id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:17Z', 'updated_at': '2021-11-21T13:53:19Z', 'revision_number': 3, 'project_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'gw_port': {'id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:b0:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:18Z', 'updated_at': '2021-11-21T13:53:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:22.751278 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Allocated IP 192.168.233.29 (c04e4031-26f3-476a-92dc-8476ff89cbca/bfdeefb6-0e0c-4625-b35a-cfbc80386912/cb431e0d-b009-419d-9f2a-352a0a7111d7) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:53:22.757364 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 8e41a24c-4ee3-43e7-88e0-f250d096d06f up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:53:22.819703 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85979494-901b-4ee2-83db-48b087acee67 None None] The sync data for ids ['93e91779-c8b9-44c0-97bb-b1f2a757239c'] in dv-cinder-768458-12-iscsi is: [{'id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'name': 'tempest-TestShelveInstance-664246061-router', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30'}], 'enable_snat': True}, 'gw_port_id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:17Z', 'updated_at': '2021-11-21T13:53:19Z', 'revision_number': 3, 'project_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'gw_port': {'id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:b0:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:18Z', 'updated_at': '2021-11-21T13:53:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:53:22.834417 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 8e41a24c-4ee3-43e7-88e0-f250d096d06f triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:22.834622 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.032638 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52380) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:23.087054 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-73415799-1d83-48a0-88f5-669f2a951a02 req-a17cf427-311f-48d9-bc94-2ef26f012d79 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 210 time: 0.0827632 Nov 21 13:53:23.115761 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Allocated IP 172.20.0.1 (25ab6676-6dc6-4d22-bb7c-bd53e740870d/6f8e95bb-7134-4b19-812b-ae4abd04687c/a1e57f2b-371b-4596-a39c-06e2d41d6dac) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:53:23.206635 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3434c302-39b1-40e7-9a31-f8a87a552529 req-cf3a9d0c-7afa-4b79-894c-beded83de5a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:23.208724 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3434c302-39b1-40e7-9a31-f8a87a552529 req-cf3a9d0c-7afa-4b79-894c-beded83de5a9 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 1098 time: 0.2722723 Nov 21 13:53:23.228599 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9ce7965e-2c1e-4a04-9c50-bbba435b3347 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.435527 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52396) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:23.446629 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9ce7965e-2c1e-4a04-9c50-bbba435b3347 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.468795 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9ce7965e-2c1e-4a04-9c50-bbba435b3347 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.510553 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3434c302-39b1-40e7-9a31-f8a87a552529 req-0ad5c1dc-e8c9-4286-acd5-73d608035a30 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2921829 Nov 21 13:53:23.526421 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-9ce7965e-2c1e-4a04-9c50-bbba435b3347 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=825adf8e1e6d40e7b6aeb36d870031ed&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4915442 Nov 21 13:53:23.536747 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.537470 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52400) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:23.586964 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4a01c13-9489-41cb-a3d7-dac5de9a0502 req-d177af16-6da5-4d6c-853a-4103097f216a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:23.595632 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b4a01c13-9489-41cb-a3d7-dac5de9a0502 req-d177af16-6da5-4d6c-853a-4103097f216a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.1951771 Nov 21 13:53:23.616945 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.656814 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5e151c22-3b16-44f2-8c87-36f81a4b5a1e admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.667783 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.685671 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ce7965e-2c1e-4a04-9c50-bbba435b3347 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=275a5dd4-5084-45ce-856f-d2a7c9704e12,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:23.693850 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Network c04e4031-26f3-476a-92dc-8476ff89cbca is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:53:23.698164 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:53:23.730237 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:53:23.744107 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b4a01c13-9489-41cb-a3d7-dac5de9a0502 req-7d1e5096-9d8b-42ff-b536-decda77a8ec6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1475344 Nov 21 13:53:23.759203 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-56989948-7caa-4b6d-82ff-7f96cf139961 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.798279 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.806985 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-56989948-7caa-4b6d-82ff-7f96cf139961 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.837903 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Pushing event updated for resources: {'Port': ['ID=cb431e0d-b009-419d-9f2a-352a0a7111d7,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:23.841487 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Network 25ab6676-6dc6-4d22-bb7c-bd53e740870d is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:53:23.857103 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5e151c22-3b16-44f2-8c87-36f81a4b5a1e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.857354 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:23.857969 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.870758 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-5e151c22-3b16-44f2-8c87-36f81a4b5a1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.890157 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:53:23.895494 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:53:23.930544 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-5e151c22-3b16-44f2-8c87-36f81a4b5a1e admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=c471420f272e475880382419b35e5950&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4865327 Nov 21 13:53:23.935667 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52402) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:23.950903 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-470894'] for router_interface, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:23.955746 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e151c22-3b16-44f2-8c87-36f81a4b5a1e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b548b193-db44-4a8d-a0a4-fbacbe7d20c5,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:24.003082 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-56989948-7caa-4b6d-82ff-7f96cf139961 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.006841 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-56989948-7caa-4b6d-82ff-7f96cf139961 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.010843 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-56989948-7caa-4b6d-82ff-7f96cf139961 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/275a5dd4-5084-45ce-856f-d2a7c9704e12 HTTP/1.1" status: 204 len: 168 time: 0.4697707 Nov 21 13:53:24.030736 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-352e92bc-db2d-4bbe-8591-d72561b1c5d9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.4660475 Nov 21 13:53:24.047418 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56989948-7caa-4b6d-82ff-7f96cf139961 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=275a5dd4-5084-45ce-856f-d2a7c9704e12,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:24.060684 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Request body: {'port': {'device_id': 'a010f06f-1270-458b-a306-5e93a074e67a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:24.072045 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Pushing event updated for resources: {'Port': ['ID=a1e57f2b-371b-4596-a39c-06e2d41d6dac,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:24.092274 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-06556d79-8379-4034-90f6-567f81619df3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.113304 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-7d1fd2f0-400d-4a22-9363-056a8b199459 None None] Provisioning complete for port cb431e0d-b009-419d-9f2a-352a0a7111d7 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:24.117660 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-7d1fd2f0-400d-4a22-9363-056a8b199459 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.143272 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-06556d79-8379-4034-90f6-567f81619df3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.245435 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-7d1fd2f0-400d-4a22-9363-056a8b199459 None None] Port cb431e0d-b009-419d-9f2a-352a0a7111d7 cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:53:24.272400 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.298358 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-06556d79-8379-4034-90f6-567f81619df3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.302295 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-06556d79-8379-4034-90f6-567f81619df3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.307111 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-06556d79-8379-4034-90f6-567f81619df3 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/b548b193-db44-4a8d-a0a4-fbacbe7d20c5 HTTP/1.1" status: 204 len: 168 time: 0.3703403 Nov 21 13:53:24.319544 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06556d79-8379-4034-90f6-567f81619df3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b548b193-db44-4a8d-a0a4-fbacbe7d20c5,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:24.377422 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:53:24.476947 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc4d2f0a-3ec2-4ddc-8692-496701b14c5a req-7f0730ab-8382-408f-9698-f4d9d0dba3d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:24.482255 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-89732724-6d9f-4eaf-8c81-aad79cdf3b5a None None] Provisioning complete for port a1e57f2b-371b-4596-a39c-06e2d41d6dac triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:24.482635 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-89732724-6d9f-4eaf-8c81-aad79cdf3b5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.485320 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fc4d2f0a-3ec2-4ddc-8692-496701b14c5a req-7f0730ab-8382-408f-9698-f4d9d0dba3d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 935 time: 0.2138908 Nov 21 13:53:24.492727 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.555384 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-89732724-6d9f-4eaf-8c81-aad79cdf3b5a None None] Port a1e57f2b-371b-4596-a39c-06e2d41d6dac cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:53:24.564506 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:24.564919 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.676842 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.700458 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:53:24.707175 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.723448 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fc4d2f0a-3ec2-4ddc-8692-496701b14c5a req-a15b6d56-85e5-48f6-8884-3d1d006f9e6c tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2372267 Nov 21 13:53:24.824627 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:24.856056 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52420) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:24.875023 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ba24ca06-9517-4883-873a-34e9c7b7351e admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.963680 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ba24ca06-9517-4883-873a-34e9c7b7351e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.967992 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ba24ca06-9517-4883-873a-34e9c7b7351e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:24.993760 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.003825 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.012760 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-ba24ca06-9517-4883-873a-34e9c7b7351e admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=72cfeaef954e448c98e4f5d86a17ce0f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1524060 Nov 21 13:53:25.012949 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52422) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:25.014619 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cb431e0d-b009-419d-9f2a-352a0a7111d7 {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:53:25.019029 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba24ca06-9517-4883-873a-34e9c7b7351e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be8b958a-c1a5-44e4-bb21-a5b28113b711,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:25.063527 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2924723b-a14c-4f22-b394-82030b304ce5 req-7f75794c-f1a0-4858-8aee-718ab1bc82b1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:25.065120 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2924723b-a14c-4f22-b394-82030b304ce5 req-7f75794c-f1a0-4858-8aee-718ab1bc82b1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.1840851 Nov 21 13:53:25.067290 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.075171 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-65bbd46b-34eb-4f70-a2b0-75b356ce45e1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.103144 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-65bbd46b-34eb-4f70-a2b0-75b356ce45e1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.120718 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Transition to ACTIVE for port object cb431e0d-b009-419d-9f2a-352a0a7111d7 will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:53:25.125368 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Pushing event updated for resources: {'Port': ['ID=a1e57f2b-371b-4596-a39c-06e2d41d6dac,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:25.138855 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.159145 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-65bbd46b-34eb-4f70-a2b0-75b356ce45e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.162338 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-65bbd46b-34eb-4f70-a2b0-75b356ce45e1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.163487 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-65bbd46b-34eb-4f70-a2b0-75b356ce45e1 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/be8b958a-c1a5-44e4-bb21-a5b28113b711 HTTP/1.1" status: 204 len: 168 time: 0.1495833 Nov 21 13:53:25.171425 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65bbd46b-34eb-4f70-a2b0-75b356ce45e1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be8b958a-c1a5-44e4-bb21-a5b28113b711,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:25.171573 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1684480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-473342'] for router_interface, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.207154 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2924723b-a14c-4f22-b394-82030b304ce5 req-76074598-7567-4a40-b8ba-b78ad8de5f1d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1272006 Nov 21 13:53:25.260519 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Pushing event updated for resources: {'Port': ['ID=cb431e0d-b009-419d-9f2a-352a0a7111d7,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:25.390272 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1168aac2-de20-4963-ab64-a0c6cda97a21 req-3dc2852c-3d82-4a1c-b2cd-0f874aada3e1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:25.392038 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Network 25ab6676-6dc6-4d22-bb7c-bd53e740870d is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:53:25.393734 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1168aac2-de20-4963-ab64-a0c6cda97a21 req-3dc2852c-3d82-4a1c-b2cd-0f874aada3e1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0607531 Nov 21 13:53:25.396995 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:53:25.415245 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Attempting to bind port cb431e0d-b009-419d-9f2a-352a0a7111d7 on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:53:25.415588 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Attempting to bind port cb431e0d-b009-419d-9f2a-352a0a7111d7 by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '85a68096-6a25-4344-bcb7-1bb29b188cdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': 'c04e4031-26f3-476a-92dc-8476ff89cbca'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:53:25.415950 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Attempting to bind port cb431e0d-b009-419d-9f2a-352a0a7111d7 on network c04e4031-26f3-476a-92dc-8476ff89cbca {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:53:25.553140 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Port cb431e0d-b009-419d-9f2a-352a0a7111d7 on network c04e4031-26f3-476a-92dc-8476ff89cbca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:53:25.553476 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Attempting to bind port cb431e0d-b009-419d-9f2a-352a0a7111d7 on network c04e4031-26f3-476a-92dc-8476ff89cbca {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:53:25.563657 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 53, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:53:25.564029 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Checking segment: {'id': '85a68096-6a25-4344-bcb7-1bb29b188cdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': 'c04e4031-26f3-476a-92dc-8476ff89cbca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:53:25.565000 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Bound using segment: {'id': '85a68096-6a25-4344-bcb7-1bb29b188cdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': 'c04e4031-26f3-476a-92dc-8476ff89cbca'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:53:25.565452 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Bound port: cb431e0d-b009-419d-9f2a-352a0a7111d7, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '85a68096-6a25-4344-bcb7-1bb29b188cdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 505, 'network_id': 'c04e4031-26f3-476a-92dc-8476ff89cbca'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:53:25.565813 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.644348 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Router 93e91779-c8b9-44c0-97bb-b1f2a757239c has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:53:25.671345 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-6bf4eac6-daf0-428c-8b71-3e6882954b90 None None] Provisioning complete for port a1e57f2b-371b-4596-a39c-06e2d41d6dac triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:25.671972 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6bf4eac6-daf0-428c-8b71-3e6882954b90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.724367 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-6bf4eac6-daf0-428c-8b71-3e6882954b90 None None] Port a1e57f2b-371b-4596-a39c-06e2d41d6dac cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:53:25.726912 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1168aac2-de20-4963-ab64-a0c6cda97a21 req-d1272b55-a29c-47b2-9ae7-4fa68a841650 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3257494 Nov 21 13:53:25.763731 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52438) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:25.780752 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-36d31846-27bd-4dd8-baef-f5fdaacbc5c4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.918347 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8013c45e-3d6f-4814-9f49-adcac31c2588 req-f429a46e-678f-46b2-9d9e-ca74fd3e1a07 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:25.919941 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8013c45e-3d6f-4814-9f49-adcac31c2588 req-f429a46e-678f-46b2-9d9e-ca74fd3e1a07 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 947 time: 0.0929022 Nov 21 13:53:25.921982 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-36d31846-27bd-4dd8-baef-f5fdaacbc5c4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.927192 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-36d31846-27bd-4dd8-baef-f5fdaacbc5c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:25.975921 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] For port cb431e0d-b009-419d-9f2a-352a0a7111d7, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:53:25.994335 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] For port cb431e0d-b009-419d-9f2a-352a0a7111d7, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cb431e0d-b009-419d-9f2a-352a0a7111d7,segment=NetworkSegment(85a68096-6a25-4344-bcb7-1bb29b188cdf),segment_id=85a68096-6a25-4344-bcb7-1bb29b188cdf)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:53:26.005096 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-36d31846-27bd-4dd8-baef-f5fdaacbc5c4 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=754dfd9386744165a0e764fb15a4947c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2401865 Nov 21 13:53:26.006246 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36d31846-27bd-4dd8-baef-f5fdaacbc5c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=213472a4-1591-408a-ac65-507c97dd7cbb,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:26.012302 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52442) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:26.049203 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:26.075129 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8013c45e-3d6f-4814-9f49-adcac31c2588 req-47afb253-7a1e-4223-a8f8-69f825c50fd9 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1439152 Nov 21 13:53:26.121228 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:26.121861 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:26.123845 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] 10.222.0.50 "PUT /v2.0/ports/cb431e0d-b009-419d-9f2a-352a0a7111d7 HTTP/1.1" status: 200 len: 1097 time: 2.0747130 Nov 21 13:53:26.128266 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a010f06f-1270-458b-a306-5e93a074e67a', 'tag': 'cb431e0d-b009-419d-9f2a-352a0a7111d7'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:53:26.131169 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd5d740a-f3dd-4d77-8707-1c945d0889f2" -d '{"events": [{"name": "network-changed", "server_uuid": "a010f06f-1270-458b-a306-5e93a074e67a", "tag": "cb431e0d-b009-419d-9f2a-352a0a7111d7"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:53:26.141815 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:53:26.149888 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-ac69f3f1-22fd-40a9-9cc9-a9ab74f3d4d8 admin admin] 10.222.0.11 "PUT /v2.0/routers/93e91779-c8b9-44c0-97bb-b1f2a757239c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4998951 Nov 21 13:53:26.162601 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e49089eb-15da-4ed9-8f91-2664eaf29d23 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:26.168279 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Sync routers for ids ['93e91779-c8b9-44c0-97bb-b1f2a757239c'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:53:26.191354 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:53:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b45e89e-0333-458d-b311-f1864c970606 x-openstack-request-id: req-8b45e89e-0333-458d-b311-f1864c970606 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:53:26.191695 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a010f06f-1270-458b-a306-5e93a074e67a", "tag": "cb431e0d-b009-419d-9f2a-352a0a7111d7", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:53:26.191926 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-8b45e89e-0333-458d-b311-f1864c970606 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:53:26.192338 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a010f06f-1270-458b-a306-5e93a074e67a', 'tag': 'cb431e0d-b009-419d-9f2a-352a0a7111d7', 'status': 'completed', 'code': 200} Nov 21 13:53:26.193509 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Routers {'93e91779-c8b9-44c0-97bb-b1f2a757239c'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:53:26.194217 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:53:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['93e91779-c8b9-44c0-97bb-b1f2a757239c'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:26.195425 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b5f6197-0a58-410e-ba31-5151ff2f4b99 service neutron] Pushing event updated for resources: {'Port': ['ID=cb431e0d-b009-419d-9f2a-352a0a7111d7,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:26.245937 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e49089eb-15da-4ed9-8f91-2664eaf29d23 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:26.303106 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd5d740a-f3dd-4d77-8707-1c945d0889f2 req-dba1eacb-9573-40ec-a0e0-5751f79f9d88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:26.304761 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-cd5d740a-f3dd-4d77-8707-1c945d0889f2 req-dba1eacb-9573-40ec-a0e0-5751f79f9d88 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=9fec3a1c72184d41a6e85ec8ece002db&device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 1100 time: 0.0869725 Nov 21 13:53:26.334493 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e49089eb-15da-4ed9-8f91-2664eaf29d23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:26.343414 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e49089eb-15da-4ed9-8f91-2664eaf29d23 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:26.347198 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-e49089eb-15da-4ed9-8f91-2664eaf29d23 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/213472a4-1591-408a-ac65-507c97dd7cbb HTTP/1.1" status: 204 len: 168 time: 0.3335831 Nov 21 13:53:26.364882 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e49089eb-15da-4ed9-8f91-2664eaf29d23 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=213472a4-1591-408a-ac65-507c97dd7cbb,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:26.377213 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-cd5d740a-f3dd-4d77-8707-1c945d0889f2 req-10d1ff38-83ce-49d7-8697-7d74048aa523 service neutron] 10.222.0.50 "GET /v2.0/networks?tenant_id=9fec3a1c72184d41a6e85ec8ece002db&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0506845 Nov 21 13:53:26.490198 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:53:26.508322 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd5d740a-f3dd-4d77-8707-1c945d0889f2 req-17587167-8e79-4574-af70-d889653a174d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:26.509962 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-cd5d740a-f3dd-4d77-8707-1c945d0889f2 req-17587167-8e79-4574-af70-d889653a174d service neutron] 10.222.0.50 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1281877 Nov 21 13:53:26.606715 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-139266f8-2915-4664-9381-ea07de636b9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:26.608348 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-139266f8-2915-4664-9381-ea07de636b9e service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=9fec3a1c72184d41a6e85ec8ece002db&device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 1100 time: 0.0531206 Nov 21 13:53:26.636280 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Set router 93e91779-c8b9-44c0-97bb-b1f2a757239c gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:53:26.663724 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-b43c951a-fe2c-42d0-8df8-ceb00a536e5b service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.29&port_id=cb431e0d-b009-419d-9f2a-352a0a7111d7 HTTP/1.1" status: 200 len: 217 time: 0.0428846 Nov 21 13:53:26.670522 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:26.671374 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:26.716080 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-2bee1dc3-998e-4776-ba6f-eaaf0ab8d735 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:26.717590 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-2bee1dc3-998e-4776-ba6f-eaaf0ab8d735 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=bfdeefb6-0e0c-4625-b35a-cfbc80386912 HTTP/1.1" status: 200 len: 843 time: 0.0455093 Nov 21 13:53:26.785978 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-5ac25e78-e8ca-41ff-b33c-8982c714f431 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:26.787460 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-5ac25e78-e8ca-41ff-b33c-8982c714f431 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=c04e4031-26f3-476a-92dc-8476ff89cbca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1179 time: 0.0602014 Nov 21 13:53:26.906997 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-c7c3af54-4bf0-4d53-809f-730b658d1eac service neutron] 10.222.0.50 "GET /v2.0/networks/c04e4031-26f3-476a-92dc-8476ff89cbca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1096215 Nov 21 13:53:26.958123 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52472) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:26.964706 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-696f79e2-0449-4310-93d0-d31f0e3dda9e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1708594432', 'description': 'tempest-secgroup-smoke-1708594432 description', 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:26.998697 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-696f79e2-0449-4310-93d0-d31f0e3dda9e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:26.999147 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'name': 'tempest-TestShelveInstance-664246061-router', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30'}], 'enable_snat': True}, 'gw_port_id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:17Z', 'updated_at': '2021-11-21T13:53:24Z', 'revision_number': 4, 'project_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'gw_port': {'id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:b0:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:18Z', 'updated_at': '2021-11-21T13:53:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'a1e57f2b-371b-4596-a39c-06e2d41d6dac', 'name': '', 'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'mac_address': 'fa:16:3e:1d:54:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '6f8e95bb-7134-4b19-812b-ae4abd04687c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:22Z', 'updated_at': '2021-11-21T13:53:24Z', 'revision_number': 2, 'project_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'subnets': [{'id': '6f8e95bb-7134-4b19-812b-ae4abd04687c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:27.036126 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-53a81d64-935b-4f34-ad45-1831d43ba2dd req-94309167-f52e-4638-8241-f6425f45db74 service neutron] 10.222.0.50 "GET /v2.0/networks/c04e4031-26f3-476a-92dc-8476ff89cbca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1110544 Nov 21 13:53:27.039925 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Checking router: 93e91779-c8b9-44c0-97bb-b1f2a757239c for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:53:27.040525 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Updating router 93e91779-c8b9-44c0-97bb-b1f2a757239c port a1e57f2b-371b-4596-a39c-06e2d41d6dac binding host dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:53:27.099526 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-696f79e2-0449-4310-93d0-d31f0e3dda9e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.103478 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.105534 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-696f79e2-0449-4310-93d0-d31f0e3dda9e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.156412 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-696f79e2-0449-4310-93d0-d31f0e3dda9e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.157647 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-696f79e2-0449-4310-93d0-d31f0e3dda9e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1972508 Nov 21 13:53:27.160779 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 52486) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:27.165407 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-83dc672a-47a2-48a5-9eee-0fcb93de4fd4 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Request body: {'security_group_rule': {'security_group_id': 'fb84cf77-f8c9-48da-99ba-8e7bf40a09ed', 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:27.167790 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-696f79e2-0449-4310-93d0-d31f0e3dda9e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:27.218956 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82b92937-9114-4b1c-87fe-1722aa82cf77 req-1e17ebdf-3543-4252-a7d2-57391533db61 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:27.231112 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-82b92937-9114-4b1c-87fe-1722aa82cf77 req-1e17ebdf-3543-4252-a7d2-57391533db61 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 947 time: 0.0815625 Nov 21 13:53:27.233398 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-83dc672a-47a2-48a5-9eee-0fcb93de4fd4 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-82b92937-9114-4b1c-87fe-1722aa82cf77 req-724e7c07-20ce-4ae5-9a5b-f72cc7559ff0 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0941453 Nov 21 13:53:27.347587 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-83dc672a-47a2-48a5-9eee-0fcb93de4fd4 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.353218 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-83dc672a-47a2-48a5-9eee-0fcb93de4fd4 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.375884 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83dc672a-47a2-48a5-9eee-0fcb93de4fd4 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bb759e34-fa92-478f-bb1f-0c6d60d58e4a,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:27.382693 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-83dc672a-47a2-48a5-9eee-0fcb93de4fd4 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.384585 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-83dc672a-47a2-48a5-9eee-0fcb93de4fd4 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2227218 Nov 21 13:53:27.387426 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 52492) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:27.393028 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-241cae3b-f12c-4f27-a63b-ee84d95e1223 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Request body: {'security_group_rule': {'security_group_id': 'fb84cf77-f8c9-48da-99ba-8e7bf40a09ed', 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:27.436349 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-241cae3b-f12c-4f27-a63b-ee84d95e1223 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.521554 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-241cae3b-f12c-4f27-a63b-ee84d95e1223 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.528006 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-241cae3b-f12c-4f27-a63b-ee84d95e1223 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.556266 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-241cae3b-f12c-4f27-a63b-ee84d95e1223 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.557662 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-241cae3b-f12c-4f27-a63b-ee84d95e1223 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1690838 Nov 21 13:53:27.558818 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-241cae3b-f12c-4f27-a63b-ee84d95e1223 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=40a4e932-8d55-47ff-b477-93526d917424,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:27.560520 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52502) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:27.565569 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-33d19ae1-b82e-4b22-b98b-9dab7aff8d34 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Request body: {'security_group_rule': {'security_group_id': 'fb84cf77-f8c9-48da-99ba-8e7bf40a09ed', 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:27.649412 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d811a6a1-b744-473d-b585-3e7865a98cac req-af22f202-f8aa-4a0e-b201-86ab1808fbcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:27.652223 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d811a6a1-b744-473d-b585-3e7865a98cac req-af22f202-f8aa-4a0e-b201-86ab1808fbcf service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=c90104f2696540809e93549d7ed3695f&device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 1098 time: 0.0717409 Nov 21 13:53:27.652376 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Publish callbacks [] for port, precommit_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.659091 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.659738 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-33d19ae1-b82e-4b22-b98b-9dab7aff8d34 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.671902 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18bdc3f-ee78-496a-86c4-a5806dcfd6b3 req-b8260f3c-2c7d-4cfd-a2e6-053f6f2c37ee tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:27.679247 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c18bdc3f-ee78-496a-86c4-a5806dcfd6b3 req-b8260f3c-2c7d-4cfd-a2e6-053f6f2c37ee tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0873201 Nov 21 13:53:27.724223 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2e687ab-1b77-48d3-88ca-5ba725503da7 None None] Pushing event updated for resources: {'Port': ['ID=a1e57f2b-371b-4596-a39c-06e2d41d6dac,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:27.804002 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c18bdc3f-ee78-496a-86c4-a5806dcfd6b3 req-aa0a1776-bac1-49db-bca9-b37f8bf7303d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1106689 Nov 21 13:53:27.806730 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Attempting to bind port a1e57f2b-371b-4596-a39c-06e2d41d6dac on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:53:27.807782 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Attempting to bind port a1e57f2b-371b-4596-a39c-06e2d41d6dac by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '5c66054f-77db-4a85-9c38-fb8c59887e07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:53:27.808161 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Attempting to bind port a1e57f2b-371b-4596-a39c-06e2d41d6dac on network 25ab6676-6dc6-4d22-bb7c-bd53e740870d {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:53:27.823528 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 53, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:53:27.823859 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d811a6a1-b744-473d-b585-3e7865a98cac req-12dada29-83d7-4050-9afa-0ed093b1956f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:27.823982 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Checking segment: {'id': '5c66054f-77db-4a85-9c38-fb8c59887e07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:53:27.824334 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.824782 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Bound using segment: {'id': '5c66054f-77db-4a85-9c38-fb8c59887e07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:53:27.825253 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Bound port: a1e57f2b-371b-4596-a39c-06e2d41d6dac, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c66054f-77db-4a85-9c38-fb8c59887e07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:53:27.825691 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.828818 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d811a6a1-b744-473d-b585-3e7865a98cac req-12dada29-83d7-4050-9afa-0ed093b1956f service neutron] 10.222.0.50 "GET /v2.0/networks?id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a HTTP/1.1" status: 200 len: 919 time: 0.1663184 Nov 21 13:53:27.831290 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-33d19ae1-b82e-4b22-b98b-9dab7aff8d34 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.837910 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-33d19ae1-b82e-4b22-b98b-9dab7aff8d34 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.859291 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33d19ae1-b82e-4b22-b98b-9dab7aff8d34 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8bd5edd1-e8ac-41bb-8b2d-7fe7850fed3f,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:27.885774 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-33d19ae1-b82e-4b22-b98b-9dab7aff8d34 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.887285 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-33d19ae1-b82e-4b22-b98b-9dab7aff8d34 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3255632 Nov 21 13:53:27.889919 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52504) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:27.892407 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d811a6a1-b744-473d-b585-3e7865a98cac req-da0f1401-40b9-459c-b785-5579b274901b service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 HTTP/1.1" status: 200 len: 217 time: 0.0536301 Nov 21 13:53:27.908707 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-ce211815-5c1e-499b-bd9e-da210ff9c7d2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Request body: {'security_group_rule': {'security_group_id': 'fb84cf77-f8c9-48da-99ba-8e7bf40a09ed', 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:27.952251 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] For port a1e57f2b-371b-4596-a39c-06e2d41d6dac, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:53:27.957403 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] For port a1e57f2b-371b-4596-a39c-06e2d41d6dac, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=a1e57f2b-371b-4596-a39c-06e2d41d6dac,segment=NetworkSegment(5c66054f-77db-4a85-9c38-fb8c59887e07),segment_id=5c66054f-77db-4a85-9c38-fb8c59887e07)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:53:27.966475 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:27.979066 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ce211815-5c1e-499b-bd9e-da210ff9c7d2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.004439 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d811a6a1-b744-473d-b585-3e7865a98cac req-5bf9dcf0-2bb6-43c8-afbf-fba1b0bee07d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:28.006533 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d811a6a1-b744-473d-b585-3e7865a98cac req-5bf9dcf0-2bb6-43c8-afbf-fba1b0bee07d service neutron] 10.222.0.50 "GET /v2.0/subnets?id=a7f1c544-97e5-450d-9032-daf1d5a3a2a3 HTTP/1.1" status: 200 len: 858 time: 0.1034739 Nov 21 13:53:28.075919 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2e687ab-1b77-48d3-88ca-5ba725503da7 None None] Pushing event updated for resources: {'Port': ['ID=a1e57f2b-371b-4596-a39c-06e2d41d6dac,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:28.079659 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Routers {'93e91779-c8b9-44c0-97bb-b1f2a757239c'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:53:28.080411 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:53:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['93e91779-c8b9-44c0-97bb-b1f2a757239c'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:28.094883 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d811a6a1-b744-473d-b585-3e7865a98cac req-26c5de60-b8b9-4141-9a81-6949ef4314b8 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0723581 Nov 21 13:53:28.132687 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ce211815-5c1e-499b-bd9e-da210ff9c7d2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.137741 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ce211815-5c1e-499b-bd9e-da210ff9c7d2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.164544 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ce211815-5c1e-499b-bd9e-da210ff9c7d2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.166630 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-ce211815-5c1e-499b-bd9e-da210ff9c7d2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2750754 Nov 21 13:53:28.167718 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce211815-5c1e-499b-bd9e-da210ff9c7d2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b369189c-0adb-4c84-9dbc-c4c8e43cb20b,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:28.169608 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52512) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:28.174897 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-2b0512d2-78d8-4997-91ae-0bf4007eef92 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Request body: {'security_group_rule': {'security_group_id': 'fb84cf77-f8c9-48da-99ba-8e7bf40a09ed', 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:28.189767 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-1add9a3c-9959-4a1d-b32a-c76e1b6b2467 None None] Provisioning complete for port a1e57f2b-371b-4596-a39c-06e2d41d6dac triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:28.190144 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-1add9a3c-9959-4a1d-b32a-c76e1b6b2467 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.203644 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.securitygroups_db [None req-2b0512d2-78d8-4997-91ae-0bf4007eef92 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Project 3f91d0ec3fb5421aa1fb95a0cb0d040d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 21 13:53:28.210861 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2b0512d2-78d8-4997-91ae-0bf4007eef92 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.243304 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d811a6a1-b744-473d-b585-3e7865a98cac req-f0792a9d-3a3c-40db-b500-51eaab279454 service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266685 Nov 21 13:53:28.244139 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] Set router 93e91779-c8b9-44c0-97bb-b1f2a757239c gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:53:28.303365 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2b0512d2-78d8-4997-91ae-0bf4007eef92 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.311012 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2b0512d2-78d8-4997-91ae-0bf4007eef92 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.334071 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b0512d2-78d8-4997-91ae-0bf4007eef92 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8deed18d-3402-41da-bb2c-469925ddcefc,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:28.345784 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2b0512d2-78d8-4997-91ae-0bf4007eef92 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.353617 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-2b0512d2-78d8-4997-91ae-0bf4007eef92 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1797321 Nov 21 13:53:28.353884 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 52518) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:28.360302 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-003e1ff1-0162-44c9-aa56-4b9d70441b26 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Request body: {'security_group_rule': {'security_group_id': 'fb84cf77-f8c9-48da-99ba-8e7bf40a09ed', 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:53:28.399248 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-1add9a3c-9959-4a1d-b32a-c76e1b6b2467 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.401235 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d811a6a1-b744-473d-b585-3e7865a98cac req-a7925b5c-f3e3-4da4-9489-3e66c1bac0ed service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1446440 Nov 21 13:53:28.401976 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.securitygroups_db [None req-003e1ff1-0162-44c9-aa56-4b9d70441b26 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Project 3f91d0ec3fb5421aa1fb95a0cb0d040d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 21 13:53:28.407628 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-003e1ff1-0162-44c9-aa56-4b9d70441b26 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.470686 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-1add9a3c-9959-4a1d-b32a-c76e1b6b2467 None None] For port a1e57f2b-371b-4596-a39c-06e2d41d6dac, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=a1e57f2b-371b-4596-a39c-06e2d41d6dac,segment=NetworkSegment(5c66054f-77db-4a85-9c38-fb8c59887e07),segment_id=5c66054f-77db-4a85-9c38-fb8c59887e07)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:53:28.476776 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-003e1ff1-0162-44c9-aa56-4b9d70441b26 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.481137 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-003e1ff1-0162-44c9-aa56-4b9d70441b26 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.481298 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-1add9a3c-9959-4a1d-b32a-c76e1b6b2467 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.496772 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-003e1ff1-0162-44c9-aa56-4b9d70441b26 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=55d055b3-87a9-47c5-9146-d3ca64bd08e7,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:28.521653 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-003e1ff1-0162-44c9-aa56-4b9d70441b26 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.523220 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-003e1ff1-0162-44c9-aa56-4b9d70441b26 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1668773 Nov 21 13:53:28.528938 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4324411-e31e-4d8b-bf99-6a47623ca204 req-41bea6d2-d329-4045-8d38-376dc608284d tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:28.530684 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b4324411-e31e-4d8b-bf99-6a47623ca204 req-41bea6d2-d329-4045-8d38-376dc608284d tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 947 time: 0.0847030 Nov 21 13:53:28.620881 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b4324411-e31e-4d8b-bf99-6a47623ca204 req-3c6dbdc6-58ab-4a58-a1d5-ee1fd994cf96 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771177 Nov 21 13:53:28.722551 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1add9a3c-9959-4a1d-b32a-c76e1b6b2467 None None] Pushing event updated for resources: {'Port': ['ID=a1e57f2b-371b-4596-a39c-06e2d41d6dac,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:28.731618 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-10310873-4b0d-48a7-b979-5cd6c2e44520 None None] Provisioning complete for port a1e57f2b-371b-4596-a39c-06e2d41d6dac triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:28.732278 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-10310873-4b0d-48a7-b979-5cd6c2e44520 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:28.788263 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'name': 'tempest-TestShelveInstance-664246061-router', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30'}], 'enable_snat': True}, 'gw_port_id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:17Z', 'updated_at': '2021-11-21T13:53:24Z', 'revision_number': 4, 'project_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'gw_port': {'id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:b0:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:18Z', 'updated_at': '2021-11-21T13:53:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'a1e57f2b-371b-4596-a39c-06e2d41d6dac', 'name': '', 'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'mac_address': 'fa:16:3e:1d:54:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '6f8e95bb-7134-4b19-812b-ae4abd04687c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:22Z', 'updated_at': '2021-11-21T13:53:27Z', 'revision_number': 4, 'project_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'subnets': [{'id': '6f8e95bb-7134-4b19-812b-ae4abd04687c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:53:28.817292 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16d76aa2-0612-4267-b024-6ea7d5d6f0b2 None None] The sync data for ids ['93e91779-c8b9-44c0-97bb-b1f2a757239c'] in dv-cinder-768458-12-iscsi is: [{'id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'name': 'tempest-TestShelveInstance-664246061-router', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30'}], 'enable_snat': True}, 'gw_port_id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:17Z', 'updated_at': '2021-11-21T13:53:24Z', 'revision_number': 4, 'project_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'gw_port': {'id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:b0:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:18Z', 'updated_at': '2021-11-21T13:53:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'a1e57f2b-371b-4596-a39c-06e2d41d6dac', 'name': '', 'network_id': '25ab6676-6dc6-4d22-bb7c-bd53e740870d', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'mac_address': 'fa:16:3e:1d:54:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '6f8e95bb-7134-4b19-812b-ae4abd04687c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:22Z', 'updated_at': '2021-11-21T13:53:27Z', 'revision_number': 4, 'project_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'subnets': [{'id': '6f8e95bb-7134-4b19-812b-ae4abd04687c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:53:28.967441 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db42c740-0af2-482c-9a6c-5123d58177f4 req-c4146891-7c91-41c4-8375-cd5453ba00f5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:28.969111 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-db42c740-0af2-482c-9a6c-5123d58177f4 req-c4146891-7c91-41c4-8375-cd5453ba00f5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0598121 Nov 21 13:53:29.032202 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-db42c740-0af2-482c-9a6c-5123d58177f4 req-b8497b47-6fcc-4fe0-b969-308e122fbf80 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0562749 Nov 21 13:53:29.527904 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device cb431e0d-b009-419d-9f2a-352a0a7111d7 details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:53:29.705729 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port cb431e0d-b009-419d-9f2a-352a0a7111d7, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cb431e0d-b009-419d-9f2a-352a0a7111d7,segment=NetworkSegment(85a68096-6a25-4344-bcb7-1bb29b188cdf),segment_id=85a68096-6a25-4344-bcb7-1bb29b188cdf)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:53:29.719920 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': 'cb431e0d-b009-419d-9f2a-352a0a7111d7', 'network_id': 'c04e4031-26f3-476a-92dc-8476ff89cbca', 'port_id': 'cb431e0d-b009-419d-9f2a-352a0a7111d7', 'mac_address': 'fa:16:3e:c9:89:c5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 505, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bfdeefb6-0e0c-4625-b35a-cfbc80386912', 'ip_address': '192.168.233.29'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:53:29.770896 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:29.787559 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cb431e0d-b009-419d-9f2a-352a0a7111d7 {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:53:29.810072 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c2302ac-3538-4110-a2cf-a4ba128d0d97 req-7e8622f8-942f-4c94-9b3b-120bd8059d48 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:29.810687 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port cb431e0d-b009-419d-9f2a-352a0a7111d7, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cb431e0d-b009-419d-9f2a-352a0a7111d7,segment=NetworkSegment(85a68096-6a25-4344-bcb7-1bb29b188cdf),segment_id=85a68096-6a25-4344-bcb7-1bb29b188cdf)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:53:29.811788 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4c2302ac-3538-4110-a2cf-a4ba128d0d97 req-7e8622f8-942f-4c94-9b3b-120bd8059d48 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 947 time: 0.0603969 Nov 21 13:53:29.815491 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:29.866689 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=cb431e0d-b009-419d-9f2a-352a0a7111d7,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:29.869412 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4c2302ac-3538-4110-a2cf-a4ba128d0d97 req-ed091b5c-3ec5-4a61-80f1-8bfd7720fd57 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486400 Nov 21 13:53:30.162032 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f15c9c5e-5995-487a-a832-6f484ba2a657 req-ddadd9f9-c423-4a53-a7ba-bf2badfc24c1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:30.163000 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-7162a0f1-ff10-4948-9711-62b9772ff29e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:30.163545 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f15c9c5e-5995-487a-a832-6f484ba2a657 req-ddadd9f9-c423-4a53-a7ba-bf2badfc24c1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0557435 Nov 21 13:53:30.198265 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['cb431e0d-b009-419d-9f2a-352a0a7111d7'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:53:30.232347 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f15c9c5e-5995-487a-a832-6f484ba2a657 req-52023cc3-4019-4840-bc78-2b12ea228447 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622892 Nov 21 13:53:30.282040 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device a1e57f2b-371b-4596-a39c-06e2d41d6dac up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:53:30.374398 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port a1e57f2b-371b-4596-a39c-06e2d41d6dac triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:30.374766 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:30.987909 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0f6275b-2737-40fd-ab4f-6ab4387d85ce req-515e665d-ad93-4f0e-906e-efa5364dd460 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:30.989377 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d0f6275b-2737-40fd-ab4f-6ab4387d85ce req-515e665d-ad93-4f0e-906e-efa5364dd460 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 948 time: 0.0473499 Nov 21 13:53:31.038755 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d0f6275b-2737-40fd-ab4f-6ab4387d85ce req-533aaa88-3a97-4d72-ae0e-66b8789f4900 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433888 Nov 21 13:53:31.357118 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef2295c6-3608-4be5-b90b-41a659886301 req-7a89a75a-5536-4cf8-a282-833bffaa4960 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:31.358733 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ef2295c6-3608-4be5-b90b-41a659886301 req-7a89a75a-5536-4cf8-a282-833bffaa4960 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0476186 Nov 21 13:53:31.415511 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ef2295c6-3608-4be5-b90b-41a659886301 req-24e9cdfe-9ddc-4ae8-84a8-9ab19c511c4b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481672 Nov 21 13:53:31.537697 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device cb431e0d-b009-419d-9f2a-352a0a7111d7 up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:53:31.596825 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port cb431e0d-b009-419d-9f2a-352a0a7111d7 completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:53:31.600603 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port cb431e0d-b009-419d-9f2a-352a0a7111d7 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:53:31.600966 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:31.677900 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:31.700423 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a010f06f-1270-458b-a306-5e93a074e67a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb431e0d-b009-419d-9f2a-352a0a7111d7'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:53:31.702866 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-503633e4-f423-488b-aa47-1aa9c658baf6" -d '{"events": [{"server_uuid": "a010f06f-1270-458b-a306-5e93a074e67a", "name": "network-vif-plugged", "status": "completed", "tag": "cb431e0d-b009-419d-9f2a-352a0a7111d7"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:53:31.720215 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port cb431e0d-b009-419d-9f2a-352a0a7111d7, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cb431e0d-b009-419d-9f2a-352a0a7111d7,segment=NetworkSegment(85a68096-6a25-4344-bcb7-1bb29b188cdf),segment_id=85a68096-6a25-4344-bcb7-1bb29b188cdf)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:53:31.726391 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:31.753375 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:53:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd8ca92d-8cb6-45ba-907a-f0c8ef694330 x-openstack-request-id: req-fd8ca92d-8cb6-45ba-907a-f0c8ef694330 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:53:31.753922 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a010f06f-1270-458b-a306-5e93a074e67a", "name": "network-vif-plugged", "status": "completed", "tag": "cb431e0d-b009-419d-9f2a-352a0a7111d7", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:53:31.754202 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-fd8ca92d-8cb6-45ba-907a-f0c8ef694330 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:53:31.754591 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a010f06f-1270-458b-a306-5e93a074e67a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb431e0d-b009-419d-9f2a-352a0a7111d7', 'code': 200} Nov 21 13:53:31.780826 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=cb431e0d-b009-419d-9f2a-352a0a7111d7,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:31.933120 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62561c75-0615-46eb-b2e4-82c4b0e40272 req-a09dbaa2-33e9-409f-9a49-9cdb728f38f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:31.934838 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-62561c75-0615-46eb-b2e4-82c4b0e40272 req-a09dbaa2-33e9-409f-9a49-9cdb728f38f6 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 1102 time: 0.0427890 Nov 21 13:53:31.990930 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-62561c75-0615-46eb-b2e4-82c4b0e40272 req-c3eef0d7-6a61-4ef8-a8a2-17e4f8de147e service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472288 Nov 21 13:53:32.164451 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82f22cf8-e035-42db-8fa2-1bd71fdc4bc7 req-1c227a1d-af97-48a3-b4e3-fa7e1b5fb980 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:32.165943 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-82f22cf8-e035-42db-8fa2-1bd71fdc4bc7 req-1c227a1d-af97-48a3-b4e3-fa7e1b5fb980 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 949 time: 0.0544145 Nov 21 13:53:32.217841 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-82f22cf8-e035-42db-8fa2-1bd71fdc4bc7 req-4d4d6b4e-350f-453e-8f81-5c56ebd069f3 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457952 Nov 21 13:53:32.529631 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-113f4be3-a378-4269-968e-5b59b0622982 req-352ccfc9-e306-4aa2-8d9d-0a0e7760645d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:32.531641 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-113f4be3-a378-4269-968e-5b59b0622982 req-352ccfc9-e306-4aa2-8d9d-0a0e7760645d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0492141 Nov 21 13:53:32.556983 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0a1f2920-0137-4d80-901a-3f77e52d8824 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:32.581212 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-113f4be3-a378-4269-968e-5b59b0622982 req-51c5e926-3500-4e47-ba1c-a500940c15f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428574 Nov 21 13:53:33.347873 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5d59614-d1b8-4ce8-b33b-6e4ca2ca64b8 req-e73848da-33fc-4f10-8799-89549a8bde0e tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:33.349679 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b5d59614-d1b8-4ce8-b33b-6e4ca2ca64b8 req-e73848da-33fc-4f10-8799-89549a8bde0e tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 949 time: 0.0531781 Nov 21 13:53:33.406950 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b5d59614-d1b8-4ce8-b33b-6e4ca2ca64b8 req-59fc01f6-2938-49b8-a7eb-461f3486bca4 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474586 Nov 21 13:53:33.704121 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8062fdc-b41a-4ebd-ae2e-f47e51db5265 req-557daca6-15b8-4e4a-9e8d-ec9f5fb694d3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:33.705627 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a8062fdc-b41a-4ebd-ae2e-f47e51db5265 req-557daca6-15b8-4e4a-9e8d-ec9f5fb694d3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0581973 Nov 21 13:53:33.753243 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a8062fdc-b41a-4ebd-ae2e-f47e51db5265 req-4b826cd9-e4d0-40d5-84f7-141289f35259 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416386 Nov 21 13:53:33.856591 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:34.527925 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf26203-3021-47e3-8e93-8a2bd4bfc753 req-24242011-669c-4461-90b9-7e9ce7fb1592 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:34.529821 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-acf26203-3021-47e3-8e93-8a2bd4bfc753 req-24242011-669c-4461-90b9-7e9ce7fb1592 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 949 time: 0.0505331 Nov 21 13:53:34.586384 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-acf26203-3021-47e3-8e93-8a2bd4bfc753 req-aceee4b5-ca80-49ec-a23a-1459fbce64fa tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456786 Nov 21 13:53:34.631663 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:53:34.850545 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31107d09-2bf6-4ffa-a776-dc2396d9ce20 req-507b0c68-6af0-4f1a-ad60-a1168ec665e4 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:34.852044 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-31107d09-2bf6-4ffa-a776-dc2396d9ce20 req-507b0c68-6af0-4f1a-ad60-a1168ec665e4 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 949 time: 0.0531683 Nov 21 13:53:34.898950 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-31107d09-2bf6-4ffa-a776-dc2396d9ce20 req-a7a7ed89-a88b-4ec9-9d32-21c8b7a91304 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409551 Nov 21 13:53:34.902260 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0a05f5-734d-4f81-8155-808272cc927d req-90a87a5e-8b6b-4cd7-b28f-928933b89c6a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:34.905262 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bc0a05f5-734d-4f81-8155-808272cc927d req-90a87a5e-8b6b-4cd7-b28f-928933b89c6a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0507252 Nov 21 13:53:34.955773 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bc0a05f5-734d-4f81-8155-808272cc927d req-02c04bfb-54a8-4c93-8fbd-1e67da50f2c6 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430667 Nov 21 13:53:35.041779 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:35.833966 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:36.014800 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20af2e42-2c17-445d-b1f3-9119a4145896 req-b5d28b74-cde2-4fc4-9289-5505bf5e3c46 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:36.016347 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-20af2e42-2c17-445d-b1f3-9119a4145896 req-b5d28b74-cde2-4fc4-9289-5505bf5e3c46 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 949 time: 0.0479476 Nov 21 13:53:36.066767 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-20af2e42-2c17-445d-b1f3-9119a4145896 req-5513d574-f256-460b-a33b-8970d8ff8cee tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437806 Nov 21 13:53:36.169325 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de7d3bbd-4a81-4c20-9cee-d069de09a7e1 req-0851e774-42a8-47dd-b90f-d68cdb6dcd02 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:36.170906 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-de7d3bbd-4a81-4c20-9cee-d069de09a7e1 req-0851e774-42a8-47dd-b90f-d68cdb6dcd02 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0494223 Nov 21 13:53:36.218024 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-de7d3bbd-4a81-4c20-9cee-d069de09a7e1 req-39b5026d-ae85-4e87-beac-d01db4d2234c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405073 Nov 21 13:53:38.703365 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aec761d-0fd7-4314-8578-1849a33f9dde req-b2c7f446-0111-4f7f-be63-f6677ea5da90 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:38.704990 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5aec761d-0fd7-4314-8578-1849a33f9dde req-b2c7f446-0111-4f7f-be63-f6677ea5da90 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 949 time: 0.0539327 Nov 21 13:53:38.744761 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61900bc7-5dd2-4058-8f5c-c434bc452175 req-aa22dcee-9f1f-4ea6-a1f7-c69f66664e3d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:38.746249 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-61900bc7-5dd2-4058-8f5c-c434bc452175 req-aa22dcee-9f1f-4ea6-a1f7-c69f66664e3d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0579021 Nov 21 13:53:38.756498 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5aec761d-0fd7-4314-8578-1849a33f9dde req-a302a948-8744-4fd3-96b5-fd7dedf8ea54 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449324 Nov 21 13:53:38.793148 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-61900bc7-5dd2-4058-8f5c-c434bc452175 req-3f5a782a-73f3-4923-beb6-90a2ef5c684a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406649 Nov 21 13:53:39.904082 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f789dd78-aa4d-4e3d-bf40-9a45e7dab5e1 req-45d04b54-3cbd-4423-99f6-db455e2788d8 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:39.912442 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f789dd78-aa4d-4e3d-bf40-9a45e7dab5e1 req-45d04b54-3cbd-4423-99f6-db455e2788d8 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 949 time: 0.0822439 Nov 21 13:53:39.935753 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 req-8529279e-b0ac-416b-afd6-a67e34b67f49 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:39.937337 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 req-8529279e-b0ac-416b-afd6-a67e34b67f49 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.50 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 949 time: 0.1025071 Nov 21 13:53:39.953060 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f05b26-bf9c-46c5-bb5f-c748f63d6bba req-676f0264-0457-4d68-b9e0-2cfe092112f1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:39.954884 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-52f05b26-bf9c-46c5-bb5f-c748f63d6bba req-676f0264-0457-4d68-b9e0-2cfe092112f1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0835338 Nov 21 13:53:39.974063 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f789dd78-aa4d-4e3d-bf40-9a45e7dab5e1 req-55fc8e8b-f1ef-4d04-b57e-4ff134b2389f tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/security-groups?id=3d079ed7-d436-4575-97d3-7328e3a65595&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573306 Nov 21 13:53:40.056520 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-52f05b26-bf9c-46c5-bb5f-c748f63d6bba req-e432610c-02ae-4dfa-8a5f-4f8b13a9ba97 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0902884 Nov 21 13:53:40.083254 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Deleting port cb431e0d-b009-419d-9f2a-352a0a7111d7 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:53:40.083602 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:40.176933 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] For port cb431e0d-b009-419d-9f2a-352a0a7111d7, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cb431e0d-b009-419d-9f2a-352a0a7111d7,segment=NetworkSegment(85a68096-6a25-4344-bcb7-1bb29b188cdf),segment_id=85a68096-6a25-4344-bcb7-1bb29b188cdf)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:53:40.177322 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:40.191314 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Calling delete_port for cb431e0d-b009-419d-9f2a-352a0a7111d7 owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:53:40.336913 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:40.350601 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['cb431e0d-b009-419d-9f2a-352a0a7111d7'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:53:40.369753 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Pushing event deleted for resources: {'Port': ['ID=cb431e0d-b009-419d-9f2a-352a0a7111d7,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:40.381428 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:40.382294 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:40.382852 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:40.383197 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:40.383553 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:40.383971 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:40.384291 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:40.384625 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:40.385014 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:40.385475 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:40.385810 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:40.386140 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:40.421250 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] No DVR routers for this DVR port cb431e0d-b009-419d-9f2a-352a0a7111d7 on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:53:40.424012 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:40.427459 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b69bd804-6cfd-4c9c-b9b2-59f32fa368c7 req-04368846-2eef-43a3-bcec-9b4c918c39d2 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.50 "DELETE /v2.0/ports/cb431e0d-b009-419d-9f2a-352a0a7111d7 HTTP/1.1" status: 204 len: 173 time: 0.4713583 Nov 21 13:53:40.427951 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a010f06f-1270-458b-a306-5e93a074e67a', 'name': 'network-vif-deleted', 'tag': 'cb431e0d-b009-419d-9f2a-352a0a7111d7'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:53:40.430432 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11730ff7-0b05-4189-8ae2-18fe687422ea" -d '{"events": [{"server_uuid": "a010f06f-1270-458b-a306-5e93a074e67a", "name": "network-vif-deleted", "tag": "cb431e0d-b009-419d-9f2a-352a0a7111d7"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:53:40.470021 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:53:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1e1db0b1-2e65-46b3-9ef0-a7daead600c5 x-openstack-request-id: req-1e1db0b1-2e65-46b3-9ef0-a7daead600c5 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:53:40.470899 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a010f06f-1270-458b-a306-5e93a074e67a", "name": "network-vif-deleted", "tag": "cb431e0d-b009-419d-9f2a-352a0a7111d7", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:53:40.471171 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-1e1db0b1-2e65-46b3-9ef0-a7daead600c5 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:53:40.471561 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a010f06f-1270-458b-a306-5e93a074e67a', 'name': 'network-vif-deleted', 'tag': 'cb431e0d-b009-419d-9f2a-352a0a7111d7', 'status': 'completed', 'code': 200} Nov 21 13:53:41.092689 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a4d7910f-bff9-4856-94cb-8a8090d0ac83 req-4457e84e-170a-4d0b-844d-d8e51c07bdc3 tempest-VolumesNegativeTest-615368009 tempest-VolumesNegativeTest-615368009-project] 10.222.0.11 "GET /v2.0/ports?device_id=a010f06f-1270-458b-a306-5e93a074e67a HTTP/1.1" status: 200 len: 210 time: 0.0284615 Nov 21 13:53:41.174235 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e571b8b1-1bc0-4b3a-8c4d-533f6bb66d71 req-b867b7fb-a531-4ec1-8194-a70f18e4693e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:41.175627 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e571b8b1-1bc0-4b3a-8c4d-533f6bb66d71 req-b867b7fb-a531-4ec1-8194-a70f18e4693e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0503576 Nov 21 13:53:41.223757 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e571b8b1-1bc0-4b3a-8c4d-533f6bb66d71 req-0df80189-3ea9-44b8-8f53-09b785d7b26c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422237 Nov 21 13:53:43.891483 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device cb431e0d-b009-419d-9f2a-352a0a7111d7 no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:53:43.912230 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: cb431e0d-b009-419d-9f2a-352a0a7111d7 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:53:43.912575 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device cb431e0d-b009-419d-9f2a-352a0a7111d7 not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:53:44.025335 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c6c8fef-93a3-4b77-9279-3fe4f0593f83 req-b3300fec-ce17-440a-bb72-897563e2fbc3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:44.030244 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3c6c8fef-93a3-4b77-9279-3fe4f0593f83 req-b3300fec-ce17-440a-bb72-897563e2fbc3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0582697 Nov 21 13:53:44.077220 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3c6c8fef-93a3-4b77-9279-3fe4f0593f83 req-4c9f9854-9d85-4eaf-8a26-6c2940fffcb2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445967 Nov 21 13:53:45.213306 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-050d1e10-a25f-4c68-827b-a280cad09ff4 req-98f912e4-1b6b-466a-99d7-f0946b1d76fa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:45.214785 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-050d1e10-a25f-4c68-827b-a280cad09ff4 req-98f912e4-1b6b-466a-99d7-f0946b1d76fa tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0515330 Nov 21 13:53:45.264129 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-050d1e10-a25f-4c68-827b-a280cad09ff4 req-0b5782ca-539d-4c98-a8e9-6f81e2e4cc88 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435028 Nov 21 13:53:46.393752 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64b904a9-e553-426d-a387-38db6d71976e req-8c6a1eba-7506-42ce-84c3-a1c27d7c9dee tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:46.395785 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-64b904a9-e553-426d-a387-38db6d71976e req-8c6a1eba-7506-42ce-84c3-a1c27d7c9dee tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0561316 Nov 21 13:53:46.451973 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-64b904a9-e553-426d-a387-38db6d71976e req-684c57e7-2e84-48e1-b60c-a58292546619 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501916 Nov 21 13:53:47.569035 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90293e61-5450-465c-94ca-dd3252def58d req-ebeb0a3f-1259-4b65-be8c-aa0ab5ec8104 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:47.570511 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-90293e61-5450-465c-94ca-dd3252def58d req-ebeb0a3f-1259-4b65-be8c-aa0ab5ec8104 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0488842 Nov 21 13:53:47.620427 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-90293e61-5450-465c-94ca-dd3252def58d req-4fbe7cec-8818-40a1-a804-b98e1479402c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430408 Nov 21 13:53:47.882308 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 53190) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:48.028574 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-18c9391a-c7a5-44d1-8fa6-4de54dd4b528 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9fec3a1c72184d41a6e85ec8ece002db&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1443996 Nov 21 13:53:48.031180 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 53194) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:48.090937 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:48.117145 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:48.168393 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:48.171297 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:48.175758 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/3d079ed7-d436-4575-97d3-7328e3a65595 HTTP/1.1" status: 204 len: 168 time: 0.1401346 Nov 21 13:53:48.181523 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d079ed7-d436-4575-97d3-7328e3a65595,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:48.188899 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:48.189264 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:48.190165 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:48.190699 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:48.191037 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:48.191603 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:48.192290 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:48.192611 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:48.193231 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:48.193817 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:48.194235 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:48.194590 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5046d8e-37ed-46f2-984b-5c238873b5b5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:53:48.752001 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef1b4aa8-5a0f-4b22-be2f-3f925eb0386c req-db2c678f-49b3-46d4-beeb-ffb8dcdefc7b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:48.753826 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ef1b4aa8-5a0f-4b22-be2f-3f925eb0386c req-db2c678f-49b3-46d4-beeb-ffb8dcdefc7b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0567496 Nov 21 13:53:48.802899 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ef1b4aa8-5a0f-4b22-be2f-3f925eb0386c req-5bbae016-390d-4c5e-80e6-de86dd33a9ed tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426946 Nov 21 13:53:49.900819 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-50cb7478-c25d-4723-9838-e5c4c4a7eb0b req-c499be86-4174-423a-9a02-33e673b72a7c service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0481722 Nov 21 13:53:49.938514 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36160eb4-049f-4be9-8ded-eb31ad2948f0 req-2f7693bd-d251-478d-9ae7-f7610f1770a5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:49.940071 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-36160eb4-049f-4be9-8ded-eb31ad2948f0 req-2f7693bd-d251-478d-9ae7-f7610f1770a5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0543060 Nov 21 13:53:49.990930 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-36160eb4-049f-4be9-8ded-eb31ad2948f0 req-16c0006a-0238-483d-983f-dd07af6cb82e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418606 Nov 21 13:53:51.104282 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf6a805f-66be-487b-9577-9c577854da96 req-7bc26cc7-e205-4d71-9397-e71f2fcb7490 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:51.105735 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-cf6a805f-66be-487b-9577-9c577854da96 req-7bc26cc7-e205-4d71-9397-e71f2fcb7490 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0500283 Nov 21 13:53:51.151446 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-cf6a805f-66be-487b-9577-9c577854da96 req-7fffb1e3-a27f-43e6-b8ef-68ffc26e24a2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398736 Nov 21 13:53:52.264670 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70efcbb3-7167-48e9-9c01-b179b5101f78 req-fc2401f2-0d9c-4140-9e34-5c5ed03c7324 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:52.266160 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-70efcbb3-7167-48e9-9c01-b179b5101f78 req-fc2401f2-0d9c-4140-9e34-5c5ed03c7324 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0478959 Nov 21 13:53:52.313940 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-70efcbb3-7167-48e9-9c01-b179b5101f78 req-9ea83e07-c7ee-486a-a019-6f5e7a402380 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411174 Nov 21 13:53:52.519408 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:52.775797 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50cb7478-c25d-4723-9838-e5c4c4a7eb0b req-37f92c64-5124-4693-9673-85a6f50e67f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:52.777281 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-50cb7478-c25d-4723-9838-e5c4c4a7eb0b req-37f92c64-5124-4693-9673-85a6f50e67f8 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=389c281a19bb49e583633f57108f7f69&device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 1098 time: 0.0403709 Nov 21 13:53:52.886479 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50cb7478-c25d-4723-9838-e5c4c4a7eb0b req-e0ad5d2e-87a2-45e9-8c25-ae8c073be368 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:52.887961 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-50cb7478-c25d-4723-9838-e5c4c4a7eb0b req-e0ad5d2e-87a2-45e9-8c25-ae8c073be368 service neutron] 10.222.0.50 "GET /v2.0/networks?id=ea19090b-8034-4904-8b6c-1752befe0b5a HTTP/1.1" status: 200 len: 912 time: 0.0898740 Nov 21 13:53:52.952810 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-50cb7478-c25d-4723-9838-e5c4c4a7eb0b req-029bd4f0-15b2-439b-b274-c959fa0fe197 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e97fd0d3-216a-4615-aa4a-a98857cba123 HTTP/1.1" status: 200 len: 1001 time: 0.0565338 Nov 21 13:53:53.016479 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50cb7478-c25d-4723-9838-e5c4c4a7eb0b req-960811f8-90b6-4afd-a6ab-d58bf1a8a65d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:53.017966 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-50cb7478-c25d-4723-9838-e5c4c4a7eb0b req-960811f8-90b6-4afd-a6ab-d58bf1a8a65d service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0 HTTP/1.1" status: 200 len: 850 time: 0.0567448 Nov 21 13:53:53.064815 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50cb7478-c25d-4723-9838-e5c4c4a7eb0b req-adde2848-3e27-4060-bcd1-fedfec143326 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:53.066745 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-50cb7478-c25d-4723-9838-e5c4c4a7eb0b req-adde2848-3e27-4060-bcd1-fedfec143326 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=ea19090b-8034-4904-8b6c-1752befe0b5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0403147 Nov 21 13:53:53.164143 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-50cb7478-c25d-4723-9838-e5c4c4a7eb0b req-50bd81b7-0bcb-4333-a66e-ed2ce13b24c8 service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880764 Nov 21 13:53:53.261584 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-50cb7478-c25d-4723-9838-e5c4c4a7eb0b req-b96c4c3b-58c4-48a7-b442-f304a0dee757 service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893681 Nov 21 13:53:53.425561 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e44e3ba-e5b0-421f-aeb4-cf0bacaa3726 req-309f7510-4dcc-4086-b41c-7e1c887e88a4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:53.427039 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3e44e3ba-e5b0-421f-aeb4-cf0bacaa3726 req-309f7510-4dcc-4086-b41c-7e1c887e88a4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0474753 Nov 21 13:53:53.476898 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3e44e3ba-e5b0-421f-aeb4-cf0bacaa3726 req-9ef2ccb6-50ad-4e54-99ba-6c08695e84b8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416126 Nov 21 13:53:54.728900 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05818daa-8994-4e06-9151-384ee1329e1e req-53733877-3746-4ba2-be0b-0b9ed89ab426 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:54.730295 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-05818daa-8994-4e06-9151-384ee1329e1e req-53733877-3746-4ba2-be0b-0b9ed89ab426 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0518539 Nov 21 13:53:54.778460 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-05818daa-8994-4e06-9151-384ee1329e1e req-143b7197-d33f-44ed-adc9-64718e68e0bf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421999 Nov 21 13:53:55.219194 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21baaa04-2f85-4686-9bf9-60e0fba31e88 req-f5b86120-d82b-4b94-b4ce-6f989dd2ef0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:55.220888 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-21baaa04-2f85-4686-9bf9-60e0fba31e88 req-f5b86120-d82b-4b94-b4ce-6f989dd2ef0e service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 1098 time: 0.0564556 Nov 21 13:53:55.288100 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-21baaa04-2f85-4686-9bf9-60e0fba31e88 req-3674de58-9cf1-4b32-9e4e-3828e3ea7fab service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458872 Nov 21 13:53:55.631744 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7baceeec-8bdc-4e39-a013-a1765446752e req-e6c8ad81-81fd-4a7f-9185-b382dbae98e3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:55.633254 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7baceeec-8bdc-4e39-a013-a1765446752e req-e6c8ad81-81fd-4a7f-9185-b382dbae98e3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0504806 Nov 21 13:53:55.682154 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7baceeec-8bdc-4e39-a013-a1765446752e req-3cda85bd-b4ad-49ba-a0db-3ad9fb7e30c4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421987 Nov 21 13:53:55.892157 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce93231e-5b53-4efc-ae2c-c1a5ef0dedb6 req-77eebd1d-0b15-40d1-b38c-88015cbc89bc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:55.893613 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ce93231e-5b53-4efc-ae2c-c1a5ef0dedb6 req-77eebd1d-0b15-40d1-b38c-88015cbc89bc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0489013 Nov 21 13:53:55.943615 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ce93231e-5b53-4efc-ae2c-c1a5ef0dedb6 req-e56ffd29-64f4-4af4-856e-ad9940449d65 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438304 Nov 21 13:53:56.267282 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ee2d4e8-9740-407e-b5c5-c8d9b7d053f4 req-5640f218-498b-45f2-97f0-389491c53526 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:56.268648 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8ee2d4e8-9740-407e-b5c5-c8d9b7d053f4 req-5640f218-498b-45f2-97f0-389491c53526 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0480940 Nov 21 13:53:56.322224 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8ee2d4e8-9740-407e-b5c5-c8d9b7d053f4 req-35b25e7c-1fa9-44ca-a3f1-4041eb2f5a43 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443184 Nov 21 13:53:56.801938 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc3894a0-8fc6-4317-9840-fc2ea15888c3 req-89e3a06a-9c2c-4f7e-9bfc-915554246a5f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:56.803456 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bc3894a0-8fc6-4317-9840-fc2ea15888c3 req-89e3a06a-9c2c-4f7e-9bfc-915554246a5f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0482011 Nov 21 13:53:56.853647 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bc3894a0-8fc6-4317-9840-fc2ea15888c3 req-866d0e3e-ca15-4745-926b-868b51cc2677 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442080 Nov 21 13:53:57.059441 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4636fd5e-7345-418c-bdab-10828be3d5a6 req-1f1cf201-0da6-4e24-89cc-58fafcd56597 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:57.060963 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4636fd5e-7345-418c-bdab-10828be3d5a6 req-1f1cf201-0da6-4e24-89cc-58fafcd56597 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0465016 Nov 21 13:53:57.108618 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4636fd5e-7345-418c-bdab-10828be3d5a6 req-b2beed9b-b3ab-4513-8f56-d8efcbf1fff1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404737 Nov 21 13:53:57.381263 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c9e5f09-e84c-4d4e-b437-94d392f88546 req-09bb2234-ded1-46a5-86a9-6ecad6ce8caf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:57.382981 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0c9e5f09-e84c-4d4e-b437-94d392f88546 req-09bb2234-ded1-46a5-86a9-6ecad6ce8caf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0787766 Nov 21 13:53:57.391302 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a97e5200-92ed-44be-828d-e48db70969c2 req-bd23d35c-3a6c-44f4-96e6-66ad34b8ec35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:57.392775 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a97e5200-92ed-44be-828d-e48db70969c2 req-bd23d35c-3a6c-44f4-96e6-66ad34b8ec35 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=c90104f2696540809e93549d7ed3695f&device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 1098 time: 0.0787852 Nov 21 13:53:57.447934 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a2adadf-8823-4f63-8e0a-ba9bdc3cd47f req-29cb21d2-4ab3-4872-ac59-0c4440f8e0d7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:57.449689 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2a2adadf-8823-4f63-8e0a-ba9bdc3cd47f req-29cb21d2-4ab3-4872-ac59-0c4440f8e0d7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0539722 Nov 21 13:53:57.497433 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2a2adadf-8823-4f63-8e0a-ba9bdc3cd47f req-8051eb68-e5c0-48f0-8b0f-4ef2b80df0c2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417645 Nov 21 13:53:57.497638 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0c9e5f09-e84c-4d4e-b437-94d392f88546 req-b0bd08cd-cfd7-43c8-b7d8-1e9459ad89f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1038015 Nov 21 13:53:57.532352 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a97e5200-92ed-44be-828d-e48db70969c2 req-8e6769d2-9b69-4fb9-aec2-34f7c9b8a985 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:57.533849 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a97e5200-92ed-44be-828d-e48db70969c2 req-8e6769d2-9b69-4fb9-aec2-34f7c9b8a985 service neutron] 10.222.0.50 "GET /v2.0/networks?id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a HTTP/1.1" status: 200 len: 919 time: 0.1328237 Nov 21 13:53:57.576339 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a97e5200-92ed-44be-828d-e48db70969c2 req-f2651b8b-3bdb-4f6b-bbc1-08d658f7bfb6 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 HTTP/1.1" status: 200 len: 217 time: 0.0342743 Nov 21 13:53:57.632487 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a97e5200-92ed-44be-828d-e48db70969c2 req-bc22118e-e1c7-43f9-a22f-e29cd2828634 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:57.633983 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a97e5200-92ed-44be-828d-e48db70969c2 req-bc22118e-e1c7-43f9-a22f-e29cd2828634 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=a7f1c544-97e5-450d-9032-daf1d5a3a2a3 HTTP/1.1" status: 200 len: 858 time: 0.0452454 Nov 21 13:53:57.671663 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a97e5200-92ed-44be-828d-e48db70969c2 req-4822d6da-a88b-4be6-b75a-d410ecdb22fa service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0286498 Nov 21 13:53:57.762954 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a97e5200-92ed-44be-828d-e48db70969c2 req-3f336c70-a696-4e11-bb77-6af63eab0376 service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821025 Nov 21 13:53:57.859421 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a97e5200-92ed-44be-828d-e48db70969c2 req-251e688c-3231-480b-8865-c18a7351f8ae service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857987 Nov 21 13:53:57.979164 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7870a015-730b-4eec-b4a7-de10c4b9d4c6 req-9aff0298-168f-4193-894a-0a43d8b1c0eb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:57.980758 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7870a015-730b-4eec-b4a7-de10c4b9d4c6 req-9aff0298-168f-4193-894a-0a43d8b1c0eb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0513284 Nov 21 13:53:58.029680 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7870a015-730b-4eec-b4a7-de10c4b9d4c6 req-d0673ee6-5221-4247-b0d8-a81f6d124074 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430014 Nov 21 13:53:58.443462 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 53402) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:58.548299 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0f34a568-2810-4c64-85fb-0461dde2361c admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:58.638164 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0f34a568-2810-4c64-85fb-0461dde2361c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:58.642726 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0f34a568-2810-4c64-85fb-0461dde2361c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:58.649122 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-585e3585-5203-4da9-9d25-612e866447aa req-ad11ea7f-2910-4d79-ac79-ee9e17ee2d94 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:58.650775 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-585e3585-5203-4da9-9d25-612e866447aa req-ad11ea7f-2910-4d79-ac79-ee9e17ee2d94 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0747459 Nov 21 13:53:58.690257 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f34a568-2810-4c64-85fb-0461dde2361c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b8c5dbf-d747-460e-8523-dc5fd2dbaa28,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:58.714949 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-585e3585-5203-4da9-9d25-612e866447aa req-b4a63b13-dac3-4b07-bd65-899bfc2e579e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557802 Nov 21 13:53:58.718544 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-0f34a568-2810-4c64-85fb-0461dde2361c admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=f30cbe2d69b94fd4a8d93eb14627481b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2739732 Nov 21 13:53:58.721613 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 53412) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:53:58.777655 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e170e9b-4ee3-4e30-a601-ac7d3c236db6 req-ddfb7289-3c25-4147-9e25-d43a4730e0da tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:58.779187 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1e170e9b-4ee3-4e30-a601-ac7d3c236db6 req-ddfb7289-3c25-4147-9e25-d43a4730e0da tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0527239 Nov 21 13:53:58.779788 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1209bfb6-0719-4a47-b243-a2ea98f2d510 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:58.820922 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1209bfb6-0719-4a47-b243-a2ea98f2d510 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:58.835931 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1e170e9b-4ee3-4e30-a601-ac7d3c236db6 req-c7730ba1-ded5-4134-bbf1-dba7f7477a63 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469899 Nov 21 13:53:58.903517 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-ee64cf80-b120-4bb4-8973-bff44b23194d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1708594432&fields=id&tenant_id=3f91d0ec3fb5421aa1fb95a0cb0d040d HTTP/1.1" status: 200 len: 267 time: 0.0803547 Nov 21 13:53:58.934328 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1209bfb6-0719-4a47-b243-a2ea98f2d510 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:58.936877 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1209bfb6-0719-4a47-b243-a2ea98f2d510 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:53:58.937960 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-1209bfb6-0719-4a47-b243-a2ea98f2d510 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/6b8c5dbf-d747-460e-8523-dc5fd2dbaa28 HTTP/1.1" status: 204 len: 168 time: 0.2151699 Nov 21 13:53:58.978593 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1209bfb6-0719-4a47-b243-a2ea98f2d510 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b8c5dbf-d747-460e-8523-dc5fd2dbaa28,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:53:59.037402 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-e9c8c390-e0e6-4e7d-885a-4ebe8df3b1c6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:59.038947 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-e9c8c390-e0e6-4e7d-885a-4ebe8df3b1c6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/networks?id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f HTTP/1.1" status: 200 len: 809 time: 0.1276531 Nov 21 13:53:59.054784 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-ea736fc5-0ce3-4242-8821-d6a0f008208f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/quotas/3f91d0ec3fb5421aa1fb95a0cb0d040d HTTP/1.1" status: 200 len: 375 time: 0.0099685 Nov 21 13:53:59.108555 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-a511f68b-b401-4bb3-8fc2-015c82787521 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=3f91d0ec3fb5421aa1fb95a0cb0d040d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0479183 Nov 21 13:53:59.160724 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1041e77-518b-4a87-b61f-c9e9dfb96fb8 req-58310d58-a799-4b49-8fbf-275a77dcb9c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:59.162519 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c1041e77-518b-4a87-b61f-c9e9dfb96fb8 req-58310d58-a799-4b49-8fbf-275a77dcb9c0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0565832 Nov 21 13:53:59.214907 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c1041e77-518b-4a87-b61f-c9e9dfb96fb8 req-b36c400a-87b6-461a-9dfc-6d517748b0e8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463576 Nov 21 13:53:59.218393 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-db609922-babe-4c72-878a-d61798f99cc7 service neutron] 10.222.0.11 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0904417 Nov 21 13:53:59.315585 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-884a23db-eb72-404c-9fd2-4d83e904d8f0 service neutron] 10.222.0.11 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0902209 Nov 21 13:53:59.623031 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-eb0b90d1-6172-4f94-bd21-b5eeac823ea8 req-1b15b53c-cd06-42b5-bcb9-56d2ca2f4696 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 210 time: 0.0261624 Nov 21 13:53:59.867990 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19744f82-3b6e-4a9c-aed0-69e71ee9facb req-639c08bf-5a84-4e2b-88b0-1b27bc85f892 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:53:59.876141 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-19744f82-3b6e-4a9c-aed0-69e71ee9facb req-639c08bf-5a84-4e2b-88b0-1b27bc85f892 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0671852 Nov 21 13:53:59.961088 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-19744f82-3b6e-4a9c-aed0-69e71ee9facb req-94e2c422-b0b1-4e7f-8942-e4bde9ba5dd4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0835483 Nov 21 13:54:00.004493 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c0563ea-3bf8-421c-ae94-944b2ea3d851 req-b24736b8-f99a-46c5-9837-eda47ffca750 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:00.006822 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8c0563ea-3bf8-421c-ae94-944b2ea3d851 req-b24736b8-f99a-46c5-9837-eda47ffca750 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0828080 Nov 21 13:54:00.070243 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8c0563ea-3bf8-421c-ae94-944b2ea3d851 req-58db4e6a-a58a-461c-b9f3-d29b571de08e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0556281 Nov 21 13:54:00.169430 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-88ce996e-3884-430b-b04c-5fee0f226b45 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:00.401569 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2586bdc-061e-4ff3-a2b6-44c3c457aa65 req-05dddb79-9dca-48e7-ba3a-bc570be53cf5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:00.403049 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f2586bdc-061e-4ff3-a2b6-44c3c457aa65 req-05dddb79-9dca-48e7-ba3a-bc570be53cf5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0647342 Nov 21 13:54:00.455290 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f2586bdc-061e-4ff3-a2b6-44c3c457aa65 req-c4408e5e-a69c-4287-b518-cc4c1bbe8495 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459504 Nov 21 13:54:00.729091 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e2432a28-1de9-4dc8-bafa-f984bf933ca9 req-d29bbbb1-15df-4157-989a-7bda5d3c9e9f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 210 time: 0.0314550 Nov 21 13:54:00.867539 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-1d89eb43-6885-4176-85c8-1a25bc3d5a46 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:00.869007 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-1d89eb43-6885-4176-85c8-1a25bc3d5a46 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.50 "GET /v2.0/networks?id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f HTTP/1.1" status: 200 len: 809 time: 0.1211543 Nov 21 13:54:00.937667 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-979b772e-6d1a-46b3-9492-6ec6862a1459 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.50 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3f91d0ec3fb5421aa1fb95a0cb0d040d HTTP/1.1" status: 200 len: 380 time: 0.0564797 Nov 21 13:54:00.952492 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-7caaa5a2-3a5b-481b-a7dd-898f5ade5bf8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Request body: {'port': {'device_id': '2707c966-28e3-43ba-9241-d5629ba92b06', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'admin_state_up': True, 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'security_groups': ['fb84cf77-f8c9-48da-99ba-8e7bf40a09ed']}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:54:01.059797 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-7caaa5a2-3a5b-481b-a7dd-898f5ade5bf8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Made reservation on behalf of 3f91d0ec3fb5421aa1fb95a0cb0d040d for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:54:01.063220 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-7caaa5a2-3a5b-481b-a7dd-898f5ade5bf8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:01.216937 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-7caaa5a2-3a5b-481b-a7dd-898f5ade5bf8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Allocated IP 172.20.0.10 (0f3bd10b-114c-4dbf-afd6-006b9d81d12f/10eb4393-a8dc-4fd9-855e-e410045be9e3/5907d47d-9ae0-44a4-adf8-9e5e784f851a) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:54:01.228865 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b07417fa-01ca-4085-b495-1ece45af6983 req-3f86d70e-471a-47de-b0b8-3ac88395dfaf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:01.230343 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b07417fa-01ca-4085-b495-1ece45af6983 req-3f86d70e-471a-47de-b0b8-3ac88395dfaf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0907450 Nov 21 13:54:01.341439 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b07417fa-01ca-4085-b495-1ece45af6983 req-87b695ba-72a6-412e-a371-9bb15f126b36 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1041000 Nov 21 13:54:01.416212 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-7caaa5a2-3a5b-481b-a7dd-898f5ade5bf8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:01.461999 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-7caaa5a2-3a5b-481b-a7dd-898f5ade5bf8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:01.481205 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-202da340-5a2f-47a1-92f5-10fa85f91fb5 req-97d14d2b-73d6-4eb8-ae80-8b08ec5ca959 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:01.483728 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-202da340-5a2f-47a1-92f5-10fa85f91fb5 req-97d14d2b-73d6-4eb8-ae80-8b08ec5ca959 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0553601 Nov 21 13:54:01.526744 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-7caaa5a2-3a5b-481b-a7dd-898f5ade5bf8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:54:01.531184 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-7caaa5a2-3a5b-481b-a7dd-898f5ade5bf8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:54:01.534205 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-7caaa5a2-3a5b-481b-a7dd-898f5ade5bf8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:54:01.543561 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7caaa5a2-3a5b-481b-a7dd-898f5ade5bf8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Pushing event updated for resources: {'Port': ['ID=5907d47d-9ae0-44a4-adf8-9e5e784f851a,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:01.552842 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-202da340-5a2f-47a1-92f5-10fa85f91fb5 req-b2c27a0f-8d05-4840-8a63-9e9555c13356 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548127 Nov 21 13:54:01.848123 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-09a88120-20e4-452c-b4ca-e749e8339ade None None] Provisioning complete for port 5907d47d-9ae0-44a4-adf8-9e5e784f851a triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:54:01.848707 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-09a88120-20e4-452c-b4ca-e749e8339ade None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:01.878430 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-7caaa5a2-3a5b-481b-a7dd-898f5ade5bf8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:01.879086 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-7caaa5a2-3a5b-481b-a7dd-898f5ade5bf8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:01.891513 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-09a88120-20e4-452c-b4ca-e749e8339ade None None] Port 5907d47d-9ae0-44a4-adf8-9e5e784f851a cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:54:01.907191 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fb0f1ad-99d8-4809-af6a-c4ccf7734273 req-f3d79aee-4ad6-4394-a432-55977e363e12 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:01.908726 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7fb0f1ad-99d8-4809-af6a-c4ccf7734273 req-f3d79aee-4ad6-4394-a432-55977e363e12 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0808754 Nov 21 13:54:01.915069 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-7caaa5a2-3a5b-481b-a7dd-898f5ade5bf8 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9664292 Nov 21 13:54:01.934476 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Request body: {'port': {'device_id': '2707c966-28e3-43ba-9241-d5629ba92b06', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:54:02.016250 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7fb0f1ad-99d8-4809-af6a-c4ccf7734273 req-7772dff8-8d9e-4fa2-9c6c-ad12576be261 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1000214 Nov 21 13:54:02.017219 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:02.031105 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a7449ea-9f92-44d1-a512-cddfc9569a2c req-a362f062-986c-4a87-8821-ee5e7676c0af tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:02.032718 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8a7449ea-9f92-44d1-a512-cddfc9569a2c req-a362f062-986c-4a87-8821-ee5e7676c0af tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 932 time: 0.0657089 Nov 21 13:54:02.096104 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8a7449ea-9f92-44d1-a512-cddfc9569a2c req-032e04ff-3167-4b7f-b4ce-5b0089330e04 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0568452 Nov 21 13:54:02.302998 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5907d47d-9ae0-44a4-adf8-9e5e784f851a {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:54:02.310245 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:02.322321 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Transition to ACTIVE for port object 5907d47d-9ae0-44a4-adf8-9e5e784f851a will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:54:02.325376 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:02.378347 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Pushing event updated for resources: {'Port': ['ID=5907d47d-9ae0-44a4-adf8-9e5e784f851a,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:02.495961 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Attempting to bind port 5907d47d-9ae0-44a4-adf8-9e5e784f851a on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:54:02.496307 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Attempting to bind port 5907d47d-9ae0-44a4-adf8-9e5e784f851a by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '4106bdcf-85b4-49b9-9a69-c6db5fd40e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:54:02.496632 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Attempting to bind port 5907d47d-9ae0-44a4-adf8-9e5e784f851a on network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:54:02.505685 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Port 5907d47d-9ae0-44a4-adf8-9e5e784f851a on network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:54:02.506019 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Attempting to bind port 5907d47d-9ae0-44a4-adf8-9e5e784f851a on network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:54:02.516738 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c665d0c-245f-4a70-9265-09404e48d08b req-344207d2-abe5-4c4e-87cf-3d88741ca9d8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:02.518231 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6c665d0c-245f-4a70-9265-09404e48d08b req-344207d2-abe5-4c4e-87cf-3d88741ca9d8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0779607 Nov 21 13:54:02.521228 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 53, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:54:02.521570 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Checking segment: {'id': '4106bdcf-85b4-49b9-9a69-c6db5fd40e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:54:02.521959 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Bound using segment: {'id': '4106bdcf-85b4-49b9-9a69-c6db5fd40e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:54:02.522393 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Bound port: 5907d47d-9ae0-44a4-adf8-9e5e784f851a, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4106bdcf-85b4-49b9-9a69-c6db5fd40e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:54:02.522751 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:02.560435 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0e19449f-f4bb-4b6b-a5fc-420ea57a665a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:02.608906 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6c665d0c-245f-4a70-9265-09404e48d08b req-af7385e2-9315-40b9-80c5-d98586478d32 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0828717 Nov 21 13:54:02.625585 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] For port 5907d47d-9ae0-44a4-adf8-9e5e784f851a, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:54:02.628979 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] For port 5907d47d-9ae0-44a4-adf8-9e5e784f851a, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:54:02.633380 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:02.668699 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:02.669332 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:02.670681 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] 10.222.0.50 "PUT /v2.0/ports/5907d47d-9ae0-44a4-adf8-9e5e784f851a HTTP/1.1" status: 200 len: 1094 time: 0.7470629 Nov 21 13:54:02.671109 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:54:02.673364 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a173755a-61c4-4384-b7b2-0daa92055abc" -d '{"events": [{"name": "network-changed", "server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:54:02.699290 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6272ad0d-9013-401a-8acb-00c35ab61cde service neutron] Pushing event updated for resources: {'Port': ['ID=5907d47d-9ae0-44a4-adf8-9e5e784f851a,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:02.731196 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:54:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac6eb361-d6fb-4fd4-9338-f92224dbe86e x-openstack-request-id: req-ac6eb361-d6fb-4fd4-9338-f92224dbe86e {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:54:02.731493 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:54:02.731751 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-ac6eb361-d6fb-4fd4-9338-f92224dbe86e {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:54:02.732187 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'status': 'completed', 'code': 200} Nov 21 13:54:02.782308 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-2ada17b0-76b4-4730-a6a7-3aa680e2cdff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:02.783863 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-2ada17b0-76b4-4730-a6a7-3aa680e2cdff service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3f91d0ec3fb5421aa1fb95a0cb0d040d&device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 1097 time: 0.0432463 Nov 21 13:54:02.834360 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-d43ac0ca-a22b-4c1e-96f5-08a5cc8643ec service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a HTTP/1.1" status: 200 len: 217 time: 0.0365591 Nov 21 13:54:02.890081 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-e6132f26-96ac-4dbd-a074-752c8888b363 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:02.891539 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-e6132f26-96ac-4dbd-a074-752c8888b363 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=10eb4393-a8dc-4fd9-855e-e410045be9e3 HTTP/1.1" status: 200 len: 848 time: 0.0497277 Nov 21 13:54:02.938395 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-a05bb237-8151-4e04-978b-5f69bace8b2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:02.940725 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-a05bb237-8151-4e04-978b-5f69bace8b2e service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0412288 Nov 21 13:54:03.039664 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-468cff7a-bc66-4e64-a45a-618cab3b07e4 service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0909615 Nov 21 13:54:03.157642 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c535e7f7-21f5-4b2b-94b8-72ab1206a9b5 req-f220979e-b485-4731-baa1-10b1c89f9b15 service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1104591 Nov 21 13:54:03.173916 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e637f81-2f03-4ed0-8052-2bd990f4b7ab req-815ff8dc-537a-4ab0-8bb9-739b7e275e63 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:03.175947 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0e637f81-2f03-4ed0-8052-2bd990f4b7ab req-815ff8dc-537a-4ab0-8bb9-739b7e275e63 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0683548 Nov 21 13:54:03.227309 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6811b02-f7de-4b5e-8989-61a7319ff104 req-9caccc31-5824-4ee8-890b-b06da9895ea2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:03.228915 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a6811b02-f7de-4b5e-8989-61a7319ff104 req-9caccc31-5824-4ee8-890b-b06da9895ea2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0509431 Nov 21 13:54:03.239460 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0e637f81-2f03-4ed0-8052-2bd990f4b7ab req-9aa5c911-b061-45a0-aeb9-c21d876b121e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571065 Nov 21 13:54:03.273429 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a173755a-61c4-4384-b7b2-0daa92055abc req-4a51b051-887a-4ea2-8604-614e35f9b1a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:03.275006 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a173755a-61c4-4384-b7b2-0daa92055abc req-4a51b051-887a-4ea2-8604-614e35f9b1a6 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3f91d0ec3fb5421aa1fb95a0cb0d040d&device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 1097 time: 0.0492413 Nov 21 13:54:03.288293 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a6811b02-f7de-4b5e-8989-61a7319ff104 req-871dcaab-68e4-4215-b644-ec9cfa1df263 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0533121 Nov 21 13:54:03.373875 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a173755a-61c4-4384-b7b2-0daa92055abc req-af91a600-7e7d-4be0-9cac-66052993cb33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:03.375250 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a173755a-61c4-4384-b7b2-0daa92055abc req-af91a600-7e7d-4be0-9cac-66052993cb33 service neutron] 10.222.0.50 "GET /v2.0/networks?id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f HTTP/1.1" status: 200 len: 910 time: 0.0858374 Nov 21 13:54:03.426954 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a173755a-61c4-4384-b7b2-0daa92055abc req-e210663f-4d47-40df-af11-70951816ea0f service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a HTTP/1.1" status: 200 len: 217 time: 0.0371566 Nov 21 13:54:03.479099 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a173755a-61c4-4384-b7b2-0daa92055abc req-97e24cf0-b934-4bca-b7b7-f1e5af51d0b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:03.481886 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a173755a-61c4-4384-b7b2-0daa92055abc req-97e24cf0-b934-4bca-b7b7-f1e5af51d0b7 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=10eb4393-a8dc-4fd9-855e-e410045be9e3 HTTP/1.1" status: 200 len: 848 time: 0.0465117 Nov 21 13:54:03.534363 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a173755a-61c4-4384-b7b2-0daa92055abc req-c5c30f2d-1043-43fb-9890-af63d5510acf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:03.535938 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a173755a-61c4-4384-b7b2-0daa92055abc req-c5c30f2d-1043-43fb-9890-af63d5510acf service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0417230 Nov 21 13:54:03.632389 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a173755a-61c4-4384-b7b2-0daa92055abc req-bf966ecd-b01b-4412-ac67-f14c050ed2dd service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0875566 Nov 21 13:54:03.767373 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb663853-ac8d-4096-9c6c-c138b8c2d927 req-567565da-7a4d-4271-8e54-fceffb9e6720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:03.768837 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bb663853-ac8d-4096-9c6c-c138b8c2d927 req-567565da-7a4d-4271-8e54-fceffb9e6720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0869722 Nov 21 13:54:03.772350 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a173755a-61c4-4384-b7b2-0daa92055abc req-925f5704-25db-4f9e-a838-9917fc89c93a service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1319103 Nov 21 13:54:03.818220 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bb663853-ac8d-4096-9c6c-c138b8c2d927 req-65f59bd4-9b52-4289-824e-c7920ab71764 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434623 Nov 21 13:54:03.859072 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:04.363512 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c48d02-1381-4a6d-b49c-24bc8996cd83 req-b1d3f5f5-464e-4a3f-a015-5cab120d0202 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:04.365066 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e3c48d02-1381-4a6d-b49c-24bc8996cd83 req-b1d3f5f5-464e-4a3f-a015-5cab120d0202 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0508296 Nov 21 13:54:04.410576 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9234bbb-14a9-4a5e-b694-5162d6d180c7 req-b7b9bc47-5e3c-43ab-9fbf-98c6c7649602 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:04.412075 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f9234bbb-14a9-4a5e-b694-5162d6d180c7 req-b7b9bc47-5e3c-43ab-9fbf-98c6c7649602 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0520809 Nov 21 13:54:04.425521 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e3c48d02-1381-4a6d-b49c-24bc8996cd83 req-1de09552-2fed-4acc-ab1b-7e62da280dcb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0522468 Nov 21 13:54:04.463533 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f9234bbb-14a9-4a5e-b694-5162d6d180c7 req-e4e00aec-fdba-4df1-b265-950e1be4824f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445304 Nov 21 13:54:04.935278 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc67033e-1275-45c7-b972-8f167831d937 req-b6751eed-dd3f-4ed5-b7f2-50cfe5c6c59b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:04.936715 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-dc67033e-1275-45c7-b972-8f167831d937 req-b6751eed-dd3f-4ed5-b7f2-50cfe5c6c59b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0502274 Nov 21 13:54:04.987702 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-dc67033e-1275-45c7-b972-8f167831d937 req-9c6a13f9-4e55-41dc-bd41-945a7d3928d4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438087 Nov 21 13:54:05.048455 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:05.545835 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e78649-6a66-421d-965b-12f5331f00f6 req-6258aeb7-61fc-4d93-93ab-dba8f1253524 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:05.547319 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-48e78649-6a66-421d-965b-12f5331f00f6 req-6258aeb7-61fc-4d93-93ab-dba8f1253524 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0482812 Nov 21 13:54:05.582545 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-154af5a0-01f7-4ea5-826c-e4af487490ee req-5a0fbc59-0b41-4d1e-bb89-ef9e02de4af2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:05.584241 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-154af5a0-01f7-4ea5-826c-e4af487490ee req-5a0fbc59-0b41-4d1e-bb89-ef9e02de4af2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0507567 Nov 21 13:54:05.602981 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-48e78649-6a66-421d-965b-12f5331f00f6 req-5e33db3a-08f6-4db6-9b8c-5cdb3ca168b7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496101 Nov 21 13:54:05.636646 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-154af5a0-01f7-4ea5-826c-e4af487490ee req-00a05719-4152-45d6-8c16-a546638308bf tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461469 Nov 21 13:54:05.837285 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:06.104847 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db941cec-1d79-4497-9fde-32f9d31b405a req-4091fa91-af22-47fd-89df-fe41fd2e5820 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:06.106221 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-db941cec-1d79-4497-9fde-32f9d31b405a req-4091fa91-af22-47fd-89df-fe41fd2e5820 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0495470 Nov 21 13:54:06.153792 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-db941cec-1d79-4497-9fde-32f9d31b405a req-9bf2e82d-4131-400e-9841-6d8129eedc3c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417604 Nov 21 13:54:06.741304 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df3d76cb-3f90-4b27-9680-9db255c1f72c req-727cce2d-3ced-4d71-9aa4-0f0d22aebfca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:06.743392 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-df3d76cb-3f90-4b27-9680-9db255c1f72c req-727cce2d-3ced-4d71-9aa4-0f0d22aebfca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0657361 Nov 21 13:54:06.771089 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e6000ba-79f2-4447-b16a-add9027e3cf3 req-361de3a1-40a3-4234-a5bb-d97f07b81d18 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:06.772631 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6e6000ba-79f2-4447-b16a-add9027e3cf3 req-361de3a1-40a3-4234-a5bb-d97f07b81d18 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0553510 Nov 21 13:54:06.796313 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-df3d76cb-3f90-4b27-9680-9db255c1f72c req-0d9105a5-e8fa-40a1-a1db-3da528ba8313 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471206 Nov 21 13:54:06.826506 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6e6000ba-79f2-4447-b16a-add9027e3cf3 req-1d6182d6-0bed-4035-a5e7-7703d9e48bda tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457733 Nov 21 13:54:07.268031 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71f2e123-c649-4217-8e8e-ff30ea437b3c req-7f84370d-6eee-42c3-b1c8-f6bab2f098d7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:07.269593 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-71f2e123-c649-4217-8e8e-ff30ea437b3c req-7f84370d-6eee-42c3-b1c8-f6bab2f098d7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0486450 Nov 21 13:54:07.326151 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-71f2e123-c649-4217-8e8e-ff30ea437b3c req-caed3857-05b2-4db6-b50a-94c48ac49a1e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0497198 Nov 21 13:54:07.930043 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a84dba1-2694-483c-826c-2d35ccbbdf80 req-b28fd0a5-f5f3-4cc9-a9e4-bb01b121168f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:07.931777 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4a84dba1-2694-483c-826c-2d35ccbbdf80 req-b28fd0a5-f5f3-4cc9-a9e4-bb01b121168f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0593281 Nov 21 13:54:07.949271 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-661c5062-f1a2-4a61-9d22-5ef51cd0fa31 req-8b72603e-b434-44b4-b671-bdb75ee08502 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:07.950810 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-661c5062-f1a2-4a61-9d22-5ef51cd0fa31 req-8b72603e-b434-44b4-b671-bdb75ee08502 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0523233 Nov 21 13:54:07.983573 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4a84dba1-2694-483c-826c-2d35ccbbdf80 req-c2699029-5831-4843-9e30-8991347bfcae tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444150 Nov 21 13:54:08.003528 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-661c5062-f1a2-4a61-9d22-5ef51cd0fa31 req-5bab8d31-b0a0-44a7-b6e4-fdce3dbe5724 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465512 Nov 21 13:54:08.442709 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10da17d-5f22-4646-9bb8-c23e99c0a3eb req-cff25414-9615-4f3f-bb37-cc25c01856d3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:08.444388 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d10da17d-5f22-4646-9bb8-c23e99c0a3eb req-cff25414-9615-4f3f-bb37-cc25c01856d3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0487812 Nov 21 13:54:08.492175 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d10da17d-5f22-4646-9bb8-c23e99c0a3eb req-9e4628ec-7174-4ac4-9eb0-8ac280d3f14a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417461 Nov 21 13:54:09.105380 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49aa1ec4-1999-4237-8c9a-bd69235124f4 req-1148d9ae-e8a1-443d-b6a5-d46309ebb7b0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:09.106898 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-49aa1ec4-1999-4237-8c9a-bd69235124f4 req-1148d9ae-e8a1-443d-b6a5-d46309ebb7b0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0485024 Nov 21 13:54:09.117969 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bbb37c6-8dbb-4b67-b3b0-ae1e21d56cb0 req-d831f6a0-4d08-4458-a40e-1ede7021593f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:09.119445 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0bbb37c6-8dbb-4b67-b3b0-ae1e21d56cb0 req-d831f6a0-4d08-4458-a40e-1ede7021593f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0478804 Nov 21 13:54:09.154059 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-49aa1ec4-1999-4237-8c9a-bd69235124f4 req-dd5e26ad-af7c-44dd-813d-3dfbdea06ce1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411370 Nov 21 13:54:09.179938 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0bbb37c6-8dbb-4b67-b3b0-ae1e21d56cb0 req-b7c81696-deed-4013-afd1-7a1d4c75f063 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490129 Nov 21 13:54:09.641327 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8cface9-ac37-4e03-b3cf-13f20cdf9ed2 req-53e01585-bbc9-4e5a-a11e-6ae081cc7deb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:09.642796 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c8cface9-ac37-4e03-b3cf-13f20cdf9ed2 req-53e01585-bbc9-4e5a-a11e-6ae081cc7deb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0740321 Nov 21 13:54:09.657916 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab1525e4-ca78-416d-b61e-b18b16ef4b87 req-f0897d02-e9c1-4aa6-b7d8-06c9d9b476b8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:09.659639 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ab1525e4-ca78-416d-b61e-b18b16ef4b87 req-f0897d02-e9c1-4aa6-b7d8-06c9d9b476b8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0548499 Nov 21 13:54:09.670392 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 req-bd4dbd86-7d72-4df3-ae64-f79d4afbb168 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:09.671864 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 req-bd4dbd86-7d72-4df3-ae64-f79d4afbb168 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=c90104f2696540809e93549d7ed3695f&device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 1098 time: 0.0668285 Nov 21 13:54:09.706518 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ab1525e4-ca78-416d-b61e-b18b16ef4b87 req-9ec29e78-bcbd-406f-ab3d-a7a7e1019220 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408242 Nov 21 13:54:09.742495 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c8cface9-ac37-4e03-b3cf-13f20cdf9ed2 req-48a8d53d-8526-4ffd-a03e-2cb015e2e1d8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0913045 Nov 21 13:54:09.781760 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 req-fb0fc66c-a6d0-492f-bd40-c3fcd8bddeb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:09.783188 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 req-fb0fc66c-a6d0-492f-bd40-c3fcd8bddeb3 service neutron] 10.222.0.50 "GET /v2.0/networks?id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a HTTP/1.1" status: 200 len: 919 time: 0.1004252 Nov 21 13:54:09.827795 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 req-a0c3b714-856c-415a-9d92-374136b745f2 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 HTTP/1.1" status: 200 len: 217 time: 0.0336316 Nov 21 13:54:09.889740 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 req-ef861829-442a-4b09-bfb0-a9708bb76b28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:09.891199 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 req-ef861829-442a-4b09-bfb0-a9708bb76b28 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=a7f1c544-97e5-450d-9032-daf1d5a3a2a3 HTTP/1.1" status: 200 len: 858 time: 0.0471957 Nov 21 13:54:09.925892 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 req-ccd13f93-247e-43a3-a5a1-1905d5b250ae service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0272582 Nov 21 13:54:10.019842 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 req-5d8d4059-a4b2-41d5-9637-e3644a813433 service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857964 Nov 21 13:54:10.112043 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5d4fabf0-86e7-4dff-9ebb-5060612eae74 req-9cd6d7c6-ac3f-48e2-a351-2ec0833bc22e service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844383 Nov 21 13:54:10.276421 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db75d8ff-d31e-48d6-8391-7768278a6153 req-d4d56642-8835-4169-b393-5b0810cebe56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:10.277938 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-db75d8ff-d31e-48d6-8391-7768278a6153 req-d4d56642-8835-4169-b393-5b0810cebe56 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0523865 Nov 21 13:54:10.295387 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5ce36a9-8eb9-495d-abae-32e012d2738b req-f6d4a804-5e74-4761-8b9e-e88564151f6b tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:10.296972 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c5ce36a9-8eb9-495d-abae-32e012d2738b req-f6d4a804-5e74-4761-8b9e-e88564151f6b tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0530601 Nov 21 13:54:10.331431 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-db75d8ff-d31e-48d6-8391-7768278a6153 req-d7c3b57b-3e00-420e-94f3-b567f23caa98 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462036 Nov 21 13:54:10.347612 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c5ce36a9-8eb9-495d-abae-32e012d2738b req-84b86e95-23b2-4a41-bcbb-f09f9e7d34b9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440838 Nov 21 13:54:10.824052 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a167ae1a-a7a5-4969-a4f9-cefc5c0aaf2a req-e233c5e7-5f74-492b-829d-c8dae4299633 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:10.825541 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a167ae1a-a7a5-4969-a4f9-cefc5c0aaf2a req-e233c5e7-5f74-492b-829d-c8dae4299633 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0526817 Nov 21 13:54:10.856764 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b30f3e34-879e-4b23-a1ba-977d07b833b2 req-630a073a-74d5-415e-aa87-bc06e3c7c80d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:10.858039 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b30f3e34-879e-4b23-a1ba-977d07b833b2 req-630a073a-74d5-415e-aa87-bc06e3c7c80d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0483654 Nov 21 13:54:10.874634 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a167ae1a-a7a5-4969-a4f9-cefc5c0aaf2a req-631c6a92-ac24-4937-8a99-e51c5c3aed6f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432134 Nov 21 13:54:10.907295 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b30f3e34-879e-4b23-a1ba-977d07b833b2 req-356e3f99-4c1f-434f-bc58-496f5377c833 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417690 Nov 21 13:54:11.450740 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0044423-2930-4f80-888f-041a1087b04b req-3138fd8f-0563-446b-8de4-b18be98e27f9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:11.452343 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b0044423-2930-4f80-888f-041a1087b04b req-3138fd8f-0563-446b-8de4-b18be98e27f9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0479898 Nov 21 13:54:11.473516 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07fed6d-1d7e-4b30-90c1-3c5544b1b737 req-79873b27-4e4b-44c0-a3e5-549223612307 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:11.474992 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f07fed6d-1d7e-4b30-90c1-3c5544b1b737 req-79873b27-4e4b-44c0-a3e5-549223612307 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0524783 Nov 21 13:54:11.516359 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b0044423-2930-4f80-888f-041a1087b04b req-4bdf74cf-4e52-46b6-bafa-8b3cc592c4bf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0554104 Nov 21 13:54:11.532369 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f07fed6d-1d7e-4b30-90c1-3c5544b1b737 req-23aa6933-a5af-4b13-b126-58d9592a588d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0512102 Nov 21 13:54:11.617750 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:54:11.754899 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 5907d47d-9ae0-44a4-adf8-9e5e784f851a details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:54:11.851331 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 5907d47d-9ae0-44a4-adf8-9e5e784f851a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:54:11.863044 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'port_id': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'mac_address': 'fa:16:3e:d6:83:35', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 515, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:54:11.901237 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:11.914892 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5907d47d-9ae0-44a4-adf8-9e5e784f851a {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:54:11.950236 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 5907d47d-9ae0-44a4-adf8-9e5e784f851a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:54:11.955439 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:12.004893 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92e91efc-e286-4d42-a593-f6c7ae1d7211 req-292feceb-d7a1-4a6d-9471-d81c4d2dc325 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:12.006646 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-92e91efc-e286-4d42-a593-f6c7ae1d7211 req-292feceb-d7a1-4a6d-9471-d81c4d2dc325 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0616655 Nov 21 13:54:12.006982 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=5907d47d-9ae0-44a4-adf8-9e5e784f851a,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:12.014233 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:12.014611 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:12.014963 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:12.015323 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:12.015661 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:12.016120 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:12.016579 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:12.016919 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:12.017270 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:12.017749 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:12.018074 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:12.018402 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:12.031463 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc06aac-cb82-472a-8e94-c98867cd6b04 req-1612f9e7-b3bd-4c6a-a2de-d6ec68e9b2f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:12.036373 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fcc06aac-cb82-472a-8e94-c98867cd6b04 req-1612f9e7-b3bd-4c6a-a2de-d6ec68e9b2f2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0569029 Nov 21 13:54:12.064578 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-92e91efc-e286-4d42-a593-f6c7ae1d7211 req-3e32151e-cdac-4799-9fad-bf2c12f35d94 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518034 Nov 21 13:54:12.082775 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fcc06aac-cb82-472a-8e94-c98867cd6b04 req-fe252e95-6081-444a-aa80-b2f055166b94 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429423 Nov 21 13:54:12.270589 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['5907d47d-9ae0-44a4-adf8-9e5e784f851a'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:54:12.636328 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09eabf8d-91c5-4960-bc3a-e6740c4cea10 req-2814124a-b4f7-4076-b89b-53411dd95f89 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:12.637863 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-09eabf8d-91c5-4960-bc3a-e6740c4cea10 req-2814124a-b4f7-4076-b89b-53411dd95f89 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0495648 Nov 21 13:54:12.650169 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f86f8551-fde2-48e8-a2df-eed165bdd3a9 req-ce8fa4ba-f2ed-4222-8e68-e9ed2157d1c4 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:12.651702 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f86f8551-fde2-48e8-a2df-eed165bdd3a9 req-ce8fa4ba-f2ed-4222-8e68-e9ed2157d1c4 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 945 time: 0.0527089 Nov 21 13:54:12.685565 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-09eabf8d-91c5-4960-bc3a-e6740c4cea10 req-9ccccde1-f3f7-4f8f-b9f6-5a640d51215f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413692 Nov 21 13:54:12.700381 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f86f8551-fde2-48e8-a2df-eed165bdd3a9 req-f15351ac-0645-43a6-af0b-00fbb7c7607e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429127 Nov 21 13:54:13.182768 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb14494a-4afb-48e0-ab6e-ba3516a0b280 req-69d3d4b9-db75-4866-8f16-b836bef05233 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:13.184169 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-eb14494a-4afb-48e0-ab6e-ba3516a0b280 req-69d3d4b9-db75-4866-8f16-b836bef05233 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0511377 Nov 21 13:54:13.195476 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80babc58-32a6-40f4-b650-54ff68ceacec req-d170d4a2-2922-4380-95cc-e54eed6d5df4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:13.196953 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-80babc58-32a6-40f4-b650-54ff68ceacec req-d170d4a2-2922-4380-95cc-e54eed6d5df4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0485632 Nov 21 13:54:13.231434 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-eb14494a-4afb-48e0-ab6e-ba3516a0b280 req-36a1ae50-c576-4f01-a592-194d5c4edba7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412560 Nov 21 13:54:13.245479 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-80babc58-32a6-40f4-b650-54ff68ceacec req-90298452-2a9c-46b4-bd9c-cb53f2524198 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418835 Nov 21 13:54:13.757670 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 5907d47d-9ae0-44a4-adf8-9e5e784f851a up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:54:13.806285 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port 5907d47d-9ae0-44a4-adf8-9e5e784f851a completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:54:13.810088 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 5907d47d-9ae0-44a4-adf8-9e5e784f851a triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:54:13.810532 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:13.812411 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5da1488e-9a3e-479c-ae58-d5687b343dd7 req-e070c534-8394-49dc-8a80-293950c70ac8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:13.813861 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5da1488e-9a3e-479c-ae58-d5687b343dd7 req-e070c534-8394-49dc-8a80-293950c70ac8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0494144 Nov 21 13:54:13.820671 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49facfe-4d02-4286-ac39-11e7e9bad83e req-0d7a49ad-8e2b-403c-9616-3b8d46e642ea tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:13.822177 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a49facfe-4d02-4286-ac39-11e7e9bad83e req-0d7a49ad-8e2b-403c-9616-3b8d46e642ea tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 945 time: 0.0490482 Nov 21 13:54:13.871196 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5da1488e-9a3e-479c-ae58-d5687b343dd7 req-801cdbbe-48c0-4af4-9144-7e4314620b5a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504317 Nov 21 13:54:13.880932 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a49facfe-4d02-4286-ac39-11e7e9bad83e req-559c9bbe-ba15-4eeb-ba73-e93263dcebd9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521233 Nov 21 13:54:13.899885 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:13.922085 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:54:13.924315 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3ac00ee6-b43b-4ffc-9aa7-5827388210a9" -d '{"events": [{"server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "name": "network-vif-plugged", "status": "completed", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:54:13.936442 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 5907d47d-9ae0-44a4-adf8-9e5e784f851a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:54:13.941162 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:13.965550 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:54:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f83bb786-da05-4e87-a31e-9f5db392ea7a x-openstack-request-id: req-f83bb786-da05-4e87-a31e-9f5db392ea7a {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:54:13.965874 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "name": "network-vif-plugged", "status": "completed", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:54:13.966147 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-f83bb786-da05-4e87-a31e-9f5db392ea7a {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:54:13.966531 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'code': 200} Nov 21 13:54:13.994287 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=5907d47d-9ae0-44a4-adf8-9e5e784f851a,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:14.221698 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac0e2745-3a7e-4ba4-8987-bbd26a70feba req-6ef984c9-b19d-43cc-8322-b5ea91638241 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:14.223230 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ac0e2745-3a7e-4ba4-8987-bbd26a70feba req-6ef984c9-b19d-43cc-8322-b5ea91638241 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 1099 time: 0.0413311 Nov 21 13:54:14.280413 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ac0e2745-3a7e-4ba4-8987-bbd26a70feba req-8c0724fe-f610-47a0-ae20-eb38d75d8cea service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407176 Nov 21 13:54:14.352370 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41d4f823-8267-4ac5-9c2f-f094614a508a req-5e50fe36-3e30-4432-926e-29e9f0ac6bdf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:14.353895 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-41d4f823-8267-4ac5-9c2f-f094614a508a req-5e50fe36-3e30-4432-926e-29e9f0ac6bdf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0489433 Nov 21 13:54:14.368876 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27f1233-c3aa-4d67-8767-01708d2d8699 req-c726833f-c806-4948-a6e4-b0ef240e6643 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:14.370535 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a27f1233-c3aa-4d67-8767-01708d2d8699 req-c726833f-c806-4948-a6e4-b0ef240e6643 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0507174 Nov 21 13:54:14.406716 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-41d4f823-8267-4ac5-9c2f-f094614a508a req-4ec07180-53f4-4d2f-80c9-dd26458a7acf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467355 Nov 21 13:54:14.420243 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a27f1233-c3aa-4d67-8767-01708d2d8699 req-836e00fa-5b6c-4104-9290-d4665b983fc1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436032 Nov 21 13:54:15.007390 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dc057c8-5cb3-4d41-aa4c-c9b2dff41946 req-5e0a75e8-f85f-46ec-8bab-b10d61973856 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:15.008966 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0dc057c8-5cb3-4d41-aa4c-c9b2dff41946 req-5e0a75e8-f85f-46ec-8bab-b10d61973856 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0573170 Nov 21 13:54:15.018104 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8924b874-9841-4cf7-a765-cdcb61e50564 req-c3af6683-6d1a-4d2a-a8f4-2c49bda03c94 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:15.019598 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8924b874-9841-4cf7-a765-cdcb61e50564 req-c3af6683-6d1a-4d2a-a8f4-2c49bda03c94 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0690839 Nov 21 13:54:15.063841 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0dc057c8-5cb3-4d41-aa4c-c9b2dff41946 req-21877bb7-df22-4b51-861a-ec64f5cd1cf9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487604 Nov 21 13:54:15.082816 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8924b874-9841-4cf7-a765-cdcb61e50564 req-1a19d931-8766-4944-8745-fc11327b58c3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0560539 Nov 21 13:54:15.527861 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-388be2cc-e076-49f5-beb7-ae00b5c88ed7 req-7ec2fb8b-085b-4408-8438-f93b4ae67646 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:15.529417 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-388be2cc-e076-49f5-beb7-ae00b5c88ed7 req-7ec2fb8b-085b-4408-8438-f93b4ae67646 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0503366 Nov 21 13:54:15.542999 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d4bbcc-ab6d-4293-b85b-1171674da9f4 req-04733443-5db6-4b8c-adb4-8667c52a7491 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:15.544476 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-01d4bbcc-ab6d-4293-b85b-1171674da9f4 req-04733443-5db6-4b8c-adb4-8667c52a7491 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0540068 Nov 21 13:54:15.583417 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-388be2cc-e076-49f5-beb7-ae00b5c88ed7 req-4c9af241-bb0c-44bc-a897-8e65fc1354f1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465126 Nov 21 13:54:15.596261 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-01d4bbcc-ab6d-4293-b85b-1171674da9f4 req-f39e6fe7-4fc8-4254-afba-ef63ef51f968 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436215 Nov 21 13:54:16.196289 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2986167a-8ccc-413f-bf2b-246f6e3cdc48 req-233182fb-2472-4363-b873-792f7453e268 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:16.197801 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2986167a-8ccc-413f-bf2b-246f6e3cdc48 req-233182fb-2472-4363-b873-792f7453e268 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0582693 Nov 21 13:54:16.235892 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-282d6618-afec-4212-8b87-cf7f396d3d1a req-85f98d79-ffaf-40b4-bd62-2ab8f8dc26ce tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:16.237382 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-282d6618-afec-4212-8b87-cf7f396d3d1a req-85f98d79-ffaf-40b4-bd62-2ab8f8dc26ce tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0676594 Nov 21 13:54:16.252879 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2986167a-8ccc-413f-bf2b-246f6e3cdc48 req-5a5b70a8-4160-4ffa-95e9-25528a22e2d4 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489359 Nov 21 13:54:16.299674 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-282d6618-afec-4212-8b87-cf7f396d3d1a req-68fa552a-3351-4cda-8b2a-c2845a8753ea tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0564976 Nov 21 13:54:16.388126 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-502d163b-406d-41af-868d-14f10d17e0ce req-2a36b07d-807d-4cd1-a3a1-0fa23148c02a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:16.389917 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-502d163b-406d-41af-868d-14f10d17e0ce req-2a36b07d-807d-4cd1-a3a1-0fa23148c02a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0572038 Nov 21 13:54:16.439314 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-502d163b-406d-41af-868d-14f10d17e0ce req-b2eb6119-3bee-4dce-9a33-59f456c8fb4f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429354 Nov 21 13:54:16.461416 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 53760) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:16.647748 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a7918d0-e68e-462c-a35b-f529d195bcfe tempest-TestShelveInstance-122745048 tempest-TestShelveInstance-122745048-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:16.652430 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-4a7918d0-e68e-462c-a35b-f529d195bcfe tempest-TestShelveInstance-122745048 tempest-TestShelveInstance-122745048-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 1094 time: 0.1870275 Nov 21 13:54:16.652825 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 53768) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:16.657381 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Request body: {'floatingip': {'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'port_id': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'fixed_ip_address': '172.20.0.10'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:54:16.715223 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for floatingip, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:16.716943 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c565c21-2a1e-4184-bd77-537aea974138 req-6308a55b-7aa5-45fa-8298-67150f7ce1f3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:16.718456 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c565c21-2a1e-4184-bd77-537aea974138 req-6308a55b-7aa5-45fa-8298-67150f7ce1f3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0538414 Nov 21 13:54:16.742265 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23befe8-3339-4081-9a8f-10fcb7b19bfe req-80a6f4c3-3b1b-4dc0-9d62-f39b69d7a9b3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:16.750036 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a23befe8-3339-4081-9a8f-10fcb7b19bfe req-80a6f4c3-3b1b-4dc0-9d62-f39b69d7a9b3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0819392 Nov 21 13:54:16.774990 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c565c21-2a1e-4184-bd77-537aea974138 req-b4bff6cf-c273-4984-8dd1-50ade5d4b9b0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494001 Nov 21 13:54:16.829201 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a23befe8-3339-4081-9a8f-10fcb7b19bfe req-bd392517-7df9-4b13-93fa-e6cfb0ad3550 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0782974 Nov 21 13:54:16.868133 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:16.972253 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Allocated IP 172.27.1.39 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/8e8bea1e-c800-4023-ae18-82bbf43edf91) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:54:17.070973 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:17.108074 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:17.148282 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:54:17.151094 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:54:17.153686 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:54:17.175615 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Pushing event updated for resources: {'Port': ['ID=8e8bea1e-c800-4023-ae18-82bbf43edf91,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:17.440860 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e8dd5b-af34-471a-a942-03d5d352fb87 req-b6658c46-e0cb-49b8-b9eb-3df312865cc8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:17.443032 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-66e8dd5b-af34-471a-a942-03d5d352fb87 req-b6658c46-e0cb-49b8-b9eb-3df312865cc8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0629597 Nov 21 13:54:17.494836 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:17.508404 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-66e8dd5b-af34-471a-a942-03d5d352fb87 req-36b5564f-4a84-447e-b3ed-c4f80cff0777 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0582690 Nov 21 13:54:17.568709 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:17.719408 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:17.725306 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:17.757507 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:17.815303 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Pushing event updated for resources: {'Port': ['ID=8e8bea1e-c800-4023-ae18-82bbf43edf91,revision_number=2']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:17.905123 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.l3_db [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Floating IP 22fcc665-3948-4cad-a8d4-ec9d56c3a5b1 associated. External IP: 172.27.1.39, port: 5907d47d-9ae0-44a4-adf8-9e5e784f851a. Nov 21 13:54:17.947748 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f06c65-5422-446f-92b0-91f4d9a8fa66 req-1e810bd4-2838-4bfb-8aed-0fd631df48dd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:17.949453 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-98f06c65-5422-446f-92b0-91f4d9a8fa66 req-1e810bd4-2838-4bfb-8aed-0fd631df48dd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0509932 Nov 21 13:54:17.961460 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d6fbc4e-862c-4b58-a55d-e5fe56259a5b req-a9523173-9ea0-43d1-9b6e-4bf121dbcf69 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:17.962942 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7d6fbc4e-862c-4b58-a55d-e5fe56259a5b req-a9523173-9ea0-43d1-9b6e-4bf121dbcf69 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.1104243 Nov 21 13:54:17.997143 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-98f06c65-5422-446f-92b0-91f4d9a8fa66 req-31712a90-ef3b-49e4-8f17-a4dfb927bd25 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416279 Nov 21 13:54:18.054793 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7d6fbc4e-862c-4b58-a55d-e5fe56259a5b req-6a4f69be-5c4a-4e95-954d-d476f3459a4e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0858645 Nov 21 13:54:18.348704 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Router bec884cd-90a7-4717-a897-0e3e2c2c310b has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:54:18.455170 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:54:18.472488 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4af1aa3-958e-459c-ade8-62ba54ef483b None None] Sync routers for ids ['bec884cd-90a7-4717-a897-0e3e2c2c310b'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:54:18.480551 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:18.482854 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4af1aa3-958e-459c-ade8-62ba54ef483b None None] Routers {'bec884cd-90a7-4717-a897-0e3e2c2c310b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:54:18.483483 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-b4af1aa3-958e-459c-ade8-62ba54ef483b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:54:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['bec884cd-90a7-4717-a897-0e3e2c2c310b'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:54:18.507120 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-e66a94cd-8888-4488-b60a-86d5b8bbf2f5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8530560 Nov 21 13:54:18.507703 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a'}] {{(pid=109040) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:54:18.509998 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a0fb9e652e748194bc1d59d499050652e1260aa6f54aa3e041aed7364c74523c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1978fc6c-da66-455a-b12f-a847a27a58eb" -d '{"events": [{"name": "network-changed", "server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]}' {{(pid=109040) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:54:18.549450 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:54:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a221ec0e-b6ab-44da-8af5-a6aedb6ba824 x-openstack-request-id: req-a221ec0e-b6ab-44da-8af5-a6aedb6ba824 {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:54:18.549939 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a", "status": "completed", "code": 200}]} {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:54:18.550370 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-a221ec0e-b6ab-44da-8af5-a6aedb6ba824 {{(pid=109040) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:54:18.551594 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'status': 'completed', 'code': 200} Nov 21 13:54:18.659372 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-0f6935cc-1df2-42d6-aab9-092a214ea664 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:18.661075 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-0f6935cc-1df2-42d6-aab9-092a214ea664 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3f91d0ec3fb5421aa1fb95a0cb0d040d&device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 1099 time: 0.0604739 Nov 21 13:54:18.664651 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2911ad36-3746-4e4a-aecd-15de1bd26635 req-68421ab3-20b8-48e3-bd12-9ae62b4962ff tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:18.666190 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2911ad36-3746-4e4a-aecd-15de1bd26635 req-68421ab3-20b8-48e3-bd12-9ae62b4962ff tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0797100 Nov 21 13:54:18.704090 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-b4af1aa3-958e-459c-ade8-62ba54ef483b None None] Set router bec884cd-90a7-4717-a897-0e3e2c2c310b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:54:18.720330 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2911ad36-3746-4e4a-aecd-15de1bd26635 req-222f2a1a-c2d9-46e9-9cbb-8ee5cf90836e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467827 Nov 21 13:54:18.761066 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-3f25bd36-f6c6-40bf-8187-4579cfd4eab9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:18.762827 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-3f25bd36-f6c6-40bf-8187-4579cfd4eab9 service neutron] 10.222.0.50 "GET /v2.0/networks?id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f HTTP/1.1" status: 200 len: 910 time: 0.0919690 Nov 21 13:54:18.830455 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-5a0caf11-f5cf-4c2e-a088-50e530547c67 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a HTTP/1.1" status: 200 len: 999 time: 0.0582070 Nov 21 13:54:18.893113 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-e7cabd62-99d1-47dc-bdbe-b6add1f1bc8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:18.894602 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-e7cabd62-99d1-47dc-bdbe-b6add1f1bc8a service neutron] 10.222.0.50 "GET /v2.0/subnets?id=10eb4393-a8dc-4fd9-855e-e410045be9e3 HTTP/1.1" status: 200 len: 848 time: 0.0514350 Nov 21 13:54:18.933998 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-b4af1aa3-958e-459c-ade8-62ba54ef483b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98'}], 'enable_snat': True}, 'gw_port_id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:53:14Z', 'revision_number': 4, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port': {'id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:45:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:12Z', 'updated_at': '2021-11-21T13:53:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': '22fcc665-3948-4cad-a8d4-ec9d56c3a5b1', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'floating_ip_address': '172.27.1.39', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'port_id': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 400, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'mac_address': 'fa:16:3e:d6:83:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2707c966-28e3-43ba-9241-d5629ba92b06', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:54:17Z', 'updated_at': '2021-11-21T13:54:17Z', 'revision_number': 0, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8e41a24c-4ee3-43e7-88e0-f250d096d06f', 'name': '', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'mac_address': 'fa:16:3e:d0:dd:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_interface', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:14Z', 'updated_at': '2021-11-21T13:53:21Z', 'revision_number': 5, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'subnets': [{'id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:54:18.951210 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-d3b0cce4-fc9b-42ee-8570-fdfdf909ebb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:18.952751 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-d3b0cce4-fc9b-42ee-8570-fdfdf909ebb3 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0401902 Nov 21 13:54:18.963321 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4af1aa3-958e-459c-ade8-62ba54ef483b None None] Checking router: bec884cd-90a7-4717-a897-0e3e2c2c310b for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:54:18.971590 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4af1aa3-958e-459c-ade8-62ba54ef483b None None] Routers {'bec884cd-90a7-4717-a897-0e3e2c2c310b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:54:18.972222 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-b4af1aa3-958e-459c-ade8-62ba54ef483b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:54:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['bec884cd-90a7-4717-a897-0e3e2c2c310b'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:54:19.052791 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-82777736-51f9-493e-af41-c7f4c26c72fb service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0898244 Nov 21 13:54:19.088256 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-b4af1aa3-958e-459c-ade8-62ba54ef483b None None] Set router bec884cd-90a7-4717-a897-0e3e2c2c310b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:54:19.180632 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0687fea6-f12d-4365-8a2c-055f65b6314a req-2cd19178-820f-44fb-838d-98c4b1849abb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:19.180888 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93de7d82-a12e-495f-bc1c-880eefe526bd req-4529ecbc-a57b-4de4-a224-2212a0e353e1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:19.182323 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-93de7d82-a12e-495f-bc1c-880eefe526bd req-4529ecbc-a57b-4de4-a224-2212a0e353e1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.1117339 Nov 21 13:54:19.188021 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0687fea6-f12d-4365-8a2c-055f65b6314a req-2cd19178-820f-44fb-838d-98c4b1849abb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0624852 Nov 21 13:54:19.193308 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1978fc6c-da66-455a-b12f-a847a27a58eb req-34edcb51-caea-44da-945d-26b350d5e4de service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1307228 Nov 21 13:54:19.238251 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0687fea6-f12d-4365-8a2c-055f65b6314a req-fa41fb5e-cda8-485a-951e-e96fc43fc9fd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493405 Nov 21 13:54:19.256306 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-93de7d82-a12e-495f-bc1c-880eefe526bd req-49e45597-6b9a-4f60-92df-8d0bcf2628e1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0619650 Nov 21 13:54:19.376112 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-b4af1aa3-958e-459c-ade8-62ba54ef483b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98'}], 'enable_snat': True}, 'gw_port_id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:53:14Z', 'revision_number': 4, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port': {'id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:45:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:12Z', 'updated_at': '2021-11-21T13:53:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': '22fcc665-3948-4cad-a8d4-ec9d56c3a5b1', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'floating_ip_address': '172.27.1.39', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'port_id': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 400, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'mac_address': 'fa:16:3e:d6:83:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2707c966-28e3-43ba-9241-d5629ba92b06', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:54:17Z', 'updated_at': '2021-11-21T13:54:17Z', 'revision_number': 0, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8e41a24c-4ee3-43e7-88e0-f250d096d06f', 'name': '', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'mac_address': 'fa:16:3e:d0:dd:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_interface', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:14Z', 'updated_at': '2021-11-21T13:53:21Z', 'revision_number': 5, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'subnets': [{'id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:54:19.413654 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4af1aa3-958e-459c-ade8-62ba54ef483b None None] The sync data for ids ['bec884cd-90a7-4717-a897-0e3e2c2c310b'] in dv-cinder-768458-12-iscsi is: [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98'}], 'enable_snat': True}, 'gw_port_id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:53:14Z', 'revision_number': 4, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port': {'id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:45:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:12Z', 'updated_at': '2021-11-21T13:53:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': '22fcc665-3948-4cad-a8d4-ec9d56c3a5b1', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'floating_ip_address': '172.27.1.39', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'port_id': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 400, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'mac_address': 'fa:16:3e:d6:83:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2707c966-28e3-43ba-9241-d5629ba92b06', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:54:17Z', 'updated_at': '2021-11-21T13:54:17Z', 'revision_number': 0, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8e41a24c-4ee3-43e7-88e0-f250d096d06f', 'name': '', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'mac_address': 'fa:16:3e:d0:dd:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_interface', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:14Z', 'updated_at': '2021-11-21T13:53:21Z', 'revision_number': 5, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'subnets': [{'id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:54:19.591829 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c1a879f-1182-45d0-b1f2-d6684c790ad1 None None] New status for floating IP 22fcc665-3948-4cad-a8d4-ec9d56c3a5b1: ACTIVE {{(pid=109042) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 13:54:19.844098 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c39508d6-f32f-4ead-837a-c9e28121733e req-94beeba1-2d10-46a6-9383-6904081d8292 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:19.845648 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c39508d6-f32f-4ead-837a-c9e28121733e req-94beeba1-2d10-46a6-9383-6904081d8292 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0514197 Nov 21 13:54:19.892667 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c39508d6-f32f-4ead-837a-c9e28121733e req-9ff6f3e4-8026-4943-b5e7-bd080f17829a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404098 Nov 21 13:54:19.980775 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 53824) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:20.081615 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-01c51955-872d-4c9e-a912-0157fa4734f4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:20.154942 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-01c51955-872d-4c9e-a912-0157fa4734f4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:20.158627 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-01c51955-872d-4c9e-a912-0157fa4734f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:20.196148 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-01c51955-872d-4c9e-a912-0157fa4734f4 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=8d7cc7dbbe9b4684ad96c9cc948db944&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2143164 Nov 21 13:54:20.196985 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01c51955-872d-4c9e-a912-0157fa4734f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa83c061-da75-4372-86d8-9ffa32383242,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:20.198807 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 53828) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:20.249413 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8e03f6c3-12b7-4c6c-8b76-e41f2745ba27 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:20.271268 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8e03f6c3-12b7-4c6c-8b76-e41f2745ba27 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:20.349935 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8e03f6c3-12b7-4c6c-8b76-e41f2745ba27 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:20.352522 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8e03f6c3-12b7-4c6c-8b76-e41f2745ba27 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:20.357049 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-8e03f6c3-12b7-4c6c-8b76-e41f2745ba27 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/aa83c061-da75-4372-86d8-9ffa32383242 HTTP/1.1" status: 204 len: 168 time: 0.1538591 Nov 21 13:54:20.364383 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e03f6c3-12b7-4c6c-8b76-e41f2745ba27 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa83c061-da75-4372-86d8-9ffa32383242,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:20.385472 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6266902b-c4d3-4dcd-b1bb-4377ee2da98e req-848449fc-aa7c-4358-b339-462fed460bb1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:20.387003 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6266902b-c4d3-4dcd-b1bb-4377ee2da98e req-848449fc-aa7c-4358-b339-462fed460bb1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0733562 Nov 21 13:54:20.411902 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eeebe69-0c82-4820-b9ff-34e69b947953 req-b9a473d4-60f5-42e6-a890-3ad1db7795aa tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:20.420342 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3eeebe69-0c82-4820-b9ff-34e69b947953 req-b9a473d4-60f5-42e6-a890-3ad1db7795aa tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0801399 Nov 21 13:54:20.443019 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6266902b-c4d3-4dcd-b1bb-4377ee2da98e req-bbbd1d95-40ed-4610-a5dc-dc08365ffcda tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471327 Nov 21 13:54:20.470109 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3eeebe69-0c82-4820-b9ff-34e69b947953 req-34bb2c68-8637-40ef-b15d-b01c10e6ff79 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464263 Nov 21 13:54:21.020145 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9bafce-9ab6-4472-b46d-cc17ddfd03e6 req-a27432ea-7a19-422c-99f6-b8fec6b58cd0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:21.021630 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5f9bafce-9ab6-4472-b46d-cc17ddfd03e6 req-a27432ea-7a19-422c-99f6-b8fec6b58cd0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0559950 Nov 21 13:54:21.068629 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5f9bafce-9ab6-4472-b46d-cc17ddfd03e6 req-4f920904-a2f8-4ffb-aac9-91c59e8803b2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410879 Nov 21 13:54:21.558727 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a4f20c-3f8f-4f24-936a-27eb91a8d4a2 req-37d75529-4672-4607-bc13-0ef3f518fec1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:21.560113 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c4a4f20c-3f8f-4f24-936a-27eb91a8d4a2 req-37d75529-4672-4607-bc13-0ef3f518fec1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0480590 Nov 21 13:54:21.585959 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a372de22-09da-48a9-a0e6-fcc1ad4291b0 req-57fe8466-f327-49a7-858f-c355b680e007 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:21.587443 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a372de22-09da-48a9-a0e6-fcc1ad4291b0 req-57fe8466-f327-49a7-858f-c355b680e007 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0476596 Nov 21 13:54:21.610321 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c4a4f20c-3f8f-4f24-936a-27eb91a8d4a2 req-40503673-b4da-45b5-9787-bb8720104768 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440676 Nov 21 13:54:21.641954 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a372de22-09da-48a9-a0e6-fcc1ad4291b0 req-5f937004-1f46-4c3f-84b4-3bc953dc78b6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0485137 Nov 21 13:54:22.182841 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a140451e-8552-4e88-9e82-1837c51ca13f req-f3662179-04ad-400e-be76-5413861d14b0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:22.184305 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a140451e-8552-4e88-9e82-1837c51ca13f req-f3662179-04ad-400e-be76-5413861d14b0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0466828 Nov 21 13:54:22.229385 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a140451e-8552-4e88-9e82-1837c51ca13f req-855d3a31-0d5c-43d2-ac7e-4246c84cf8f1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392919 Nov 21 13:54:22.525881 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:22.725373 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b406f7e0-55ff-46ae-b337-fb70a5815430 req-ec71fa2f-607e-44a3-9535-6a77e7de01a2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:22.726847 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b406f7e0-55ff-46ae-b337-fb70a5815430 req-ec71fa2f-607e-44a3-9535-6a77e7de01a2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0502200 Nov 21 13:54:22.764813 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3f2dcf-bfb1-43a0-b346-2607865a790c req-659cbf95-6abe-4227-9d55-7fb97f9e85b0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:22.766213 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ad3f2dcf-bfb1-43a0-b346-2607865a790c req-659cbf95-6abe-4227-9d55-7fb97f9e85b0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0484416 Nov 21 13:54:22.776768 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b406f7e0-55ff-46ae-b337-fb70a5815430 req-460df477-fcd4-4345-be24-179c5f841afd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439408 Nov 21 13:54:22.812769 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ad3f2dcf-bfb1-43a0-b346-2607865a790c req-659dc911-e8c6-43b3-9ae1-835ad9e335a4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403891 Nov 21 13:54:23.007380 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ba7e33e-24ab-4d87-b93e-1367d880db54 req-5e2b85b0-19af-4998-b576-cc832c91266e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:23.008865 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8ba7e33e-24ab-4d87-b93e-1367d880db54 req-5e2b85b0-19af-4998-b576-cc832c91266e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0526383 Nov 21 13:54:23.057078 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8ba7e33e-24ab-4d87-b93e-1367d880db54 req-e5edff6b-ab83-4f7d-9d48-7e61facad374 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420852 Nov 21 13:54:23.076388 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 req-b2f6c80c-97f9-4fce-a1be-34fc723b34d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:23.077867 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 req-b2f6c80c-97f9-4fce-a1be-34fc723b34d5 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=389c281a19bb49e583633f57108f7f69&device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 1098 time: 0.0406408 Nov 21 13:54:23.169618 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 req-e5df6a7b-4ae2-4983-a165-24e10df5894d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:23.171066 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 req-e5df6a7b-4ae2-4983-a165-24e10df5894d service neutron] 10.222.0.50 "GET /v2.0/networks?id=ea19090b-8034-4904-8b6c-1752befe0b5a HTTP/1.1" status: 200 len: 912 time: 0.0843961 Nov 21 13:54:23.242995 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 req-e7246267-38f9-4ddf-8f46-6a9946f9afc1 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e97fd0d3-216a-4615-aa4a-a98857cba123 HTTP/1.1" status: 200 len: 1001 time: 0.0589001 Nov 21 13:54:23.294573 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 req-7cee61b9-75dc-48c7-b238-5c44df5b0997 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:23.296076 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 req-7cee61b9-75dc-48c7-b238-5c44df5b0997 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0 HTTP/1.1" status: 200 len: 850 time: 0.0454793 Nov 21 13:54:23.374911 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 req-142ad94d-83d4-4ec2-8b78-a95fc15e0301 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:23.376588 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 req-142ad94d-83d4-4ec2-8b78-a95fc15e0301 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=ea19090b-8034-4904-8b6c-1752befe0b5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0712073 Nov 21 13:54:23.384480 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84fde8de-f6cb-4edf-afc2-68f84364de4b req-bd3caa41-016a-4c7c-84bb-931375a873d7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:23.385794 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-84fde8de-f6cb-4edf-afc2-68f84364de4b req-bd3caa41-016a-4c7c-84bb-931375a873d7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0796332 Nov 21 13:54:23.483439 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-84fde8de-f6cb-4edf-afc2-68f84364de4b req-f403cf5b-f712-4804-8a54-1729d538e861 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0901167 Nov 21 13:54:23.498308 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 req-ab7a9845-6b1c-4fb7-b021-7499458dfd60 service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1116138 Nov 21 13:54:23.593866 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec1afb12-ac86-49bb-8fa1-fd42337fd1a0 req-03972022-d8a2-417f-bbfb-4eb85da40c7e service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844643 Nov 21 13:54:23.785999 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 627d561d-d2ff-449e-a99f-9e5e3fd874ba details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:54:23.886913 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:54:23.892811 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95ce89a1-9c0e-403f-b2af-c48772ce208e req-4e72abd5-32a0-4c20-9bae-336381b737ac tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:23.894267 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-95ce89a1-9c0e-403f-b2af-c48772ce208e req-4e72abd5-32a0-4c20-9bae-336381b737ac tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0467048 Nov 21 13:54:23.899089 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'port_id': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'mac_address': 'fa:16:3e:1c:94:81', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 524, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:54:23.935105 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:23.940205 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-95ce89a1-9c0e-403f-b2af-c48772ce208e req-cf970fad-d7f4-46f4-9676-d5f34ed4cd59 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392175 Nov 21 13:54:23.947768 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 627d561d-d2ff-449e-a99f-9e5e3fd874ba {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:54:23.966850 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:54:23.970177 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:24.016506 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=627d561d-d2ff-449e-a99f-9e5e3fd874ba,revision_number=6']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:24.118973 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['627d561d-d2ff-449e-a99f-9e5e3fd874ba'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:54:24.174488 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dff8d2e-cad2-48e8-ab4f-91b5da087bb1 req-455ba13b-aba1-4cbf-8273-9cddac6b5b0b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:24.175984 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2dff8d2e-cad2-48e8-ab4f-91b5da087bb1 req-455ba13b-aba1-4cbf-8273-9cddac6b5b0b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0487399 Nov 21 13:54:24.224806 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2dff8d2e-cad2-48e8-ab4f-91b5da087bb1 req-3e662c5c-f0d8-48b9-ab04-ececa75d2dc2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419662 Nov 21 13:54:24.602110 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bba13aaf-c055-4077-be97-b796063fc43a req-92cdd898-2a15-4cf3-aee8-17b95faebcbf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:24.603539 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-bba13aaf-c055-4077-be97-b796063fc43a req-92cdd898-2a15-4cf3-aee8-17b95faebcbf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 945 time: 0.0499842 Nov 21 13:54:24.649589 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-bba13aaf-c055-4077-be97-b796063fc43a req-5be48879-62ab-4f29-8215-d7824eb56733 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402462 Nov 21 13:54:25.088379 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-820463a8-c5f9-4dfe-ba8b-56596cc17406 req-7f7bc72e-e63f-447e-8c28-70bc203c5d27 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:25.089896 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-820463a8-c5f9-4dfe-ba8b-56596cc17406 req-7f7bc72e-e63f-447e-8c28-70bc203c5d27 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0612924 Nov 21 13:54:25.143421 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-820463a8-c5f9-4dfe-ba8b-56596cc17406 req-3863bbce-be54-4222-affb-e31eea0713fd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467024 Nov 21 13:54:25.373418 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fad6c09-28f1-4300-8257-60cf35987b92 req-21f96352-e0d5-42fe-a872-d5bf6b422e26 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:25.375151 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3fad6c09-28f1-4300-8257-60cf35987b92 req-21f96352-e0d5-42fe-a872-d5bf6b422e26 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0640371 Nov 21 13:54:25.434141 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3fad6c09-28f1-4300-8257-60cf35987b92 req-2150fb87-168e-45fa-abce-b2e329ae8365 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0515769 Nov 21 13:54:25.780706 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5340705-fb44-433a-b494-1f68df417f7b req-49139e4f-8ecf-4128-9f19-52a6af8f8322 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:25.782182 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a5340705-fb44-433a-b494-1f68df417f7b req-49139e4f-8ecf-4128-9f19-52a6af8f8322 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 945 time: 0.0515110 Nov 21 13:54:25.812324 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 627d561d-d2ff-449e-a99f-9e5e3fd874ba up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:54:25.843296 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a5340705-fb44-433a-b494-1f68df417f7b req-f57a305f-d19e-47d5-a9b5-3d97bd08c04f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511537 Nov 21 13:54:25.883570 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 627d561d-d2ff-449e-a99f-9e5e3fd874ba triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:54:25.884125 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:25.968994 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:25.995484 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:54:25.997790 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3280d231-4879-497d-870f-c0980da08ecc" -d '{"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-plugged", "status": "completed", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:54:26.012902 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:54:26.026728 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:26.047634 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:54:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-28633a24-ea1c-4909-a714-b8af43dc42b1 x-openstack-request-id: req-28633a24-ea1c-4909-a714-b8af43dc42b1 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:54:26.048577 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-plugged", "status": "completed", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:54:26.048929 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-28633a24-ea1c-4909-a714-b8af43dc42b1 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:54:26.049237 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'code': 200} Nov 21 13:54:26.100069 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=627d561d-d2ff-449e-a99f-9e5e3fd874ba,revision_number=7']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:26.289177 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f6abf8-495b-4a9e-a0e6-978989eb0164 req-b648d64c-a021-428b-b3de-99ccffaae48a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:26.297159 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-92f6abf8-495b-4a9e-a0e6-978989eb0164 req-b648d64c-a021-428b-b3de-99ccffaae48a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0680335 Nov 21 13:54:26.353910 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-92f6abf8-495b-4a9e-a0e6-978989eb0164 req-6eb7b1a5-710d-4a98-9ac8-dbc0f3d52a81 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555997 Nov 21 13:54:27.095041 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c92b534-230b-49ba-8600-f9197242aacf req-6ca48da3-355d-4282-8f88-1850b8755507 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:27.096532 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8c92b534-230b-49ba-8600-f9197242aacf req-6ca48da3-355d-4282-8f88-1850b8755507 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0608020 Nov 21 13:54:27.151083 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8c92b534-230b-49ba-8600-f9197242aacf req-05694bbe-a18c-4dbc-b0e3-760301c2b18b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477054 Nov 21 13:54:27.496563 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab963b14-4979-4ef1-9fc6-f2e5fa91aa33 req-fdde48ec-1794-40bd-8ac3-b6fa2247bdb3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:27.500278 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ab963b14-4979-4ef1-9fc6-f2e5fa91aa33 req-fdde48ec-1794-40bd-8ac3-b6fa2247bdb3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0619845 Nov 21 13:54:27.557260 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ab963b14-4979-4ef1-9fc6-f2e5fa91aa33 req-f37dbcb3-3480-4fcc-8d58-0d7e5dcc206b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502748 Nov 21 13:54:28.287435 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae0b710-8eff-4b10-a3e4-fdf91b15ad4e req-20237ae5-0cd5-422b-9f93-915bf7976444 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:28.290987 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-cae0b710-8eff-4b10-a3e4-fdf91b15ad4e req-20237ae5-0cd5-422b-9f93-915bf7976444 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0543411 Nov 21 13:54:28.343286 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-cae0b710-8eff-4b10-a3e4-fdf91b15ad4e req-b5b8fba0-c909-4fb6-a60e-60dc804da995 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477219 Nov 21 13:54:28.683903 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f4564f8-891f-40e1-a9f2-9ab2f07162a8 req-15010bc1-cf5f-44e7-9374-b8414d985838 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:28.686297 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9f4564f8-891f-40e1-a9f2-9ab2f07162a8 req-15010bc1-cf5f-44e7-9374-b8414d985838 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0524421 Nov 21 13:54:28.741771 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9f4564f8-891f-40e1-a9f2-9ab2f07162a8 req-6ee9b812-0d9c-49ea-b321-e675d985bd9b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481777 Nov 21 13:54:29.478800 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-090e559f-7c50-49ce-9602-95028088094c req-77f1fa74-ca9b-4bf6-a069-ffbc0c0c8182 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:29.480388 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-090e559f-7c50-49ce-9602-95028088094c req-77f1fa74-ca9b-4bf6-a069-ffbc0c0c8182 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0598848 Nov 21 13:54:29.532342 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-090e559f-7c50-49ce-9602-95028088094c req-4906e67c-0590-46c1-a0ee-2ea3a6231246 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436130 Nov 21 13:54:29.871084 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3233ea0d-0838-40ab-ba57-88233d0f2802 req-d2ff391d-6bf0-4488-a17b-c78d800d5102 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:29.878683 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3233ea0d-0838-40ab-ba57-88233d0f2802 req-d2ff391d-6bf0-4488-a17b-c78d800d5102 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0627475 Nov 21 13:54:29.926318 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3233ea0d-0838-40ab-ba57-88233d0f2802 req-943a38d5-b51c-4288-b22b-de71333c36f5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467288 Nov 21 13:54:30.168054 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fd7b8002-f79c-456e-b2d0-e54864c7b7ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:30.681741 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e6fd19b-e9f0-4793-b332-1b74a4d2b203 req-5c615243-02d2-40ca-be42-49a47b8201f2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:30.683252 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1e6fd19b-e9f0-4793-b332-1b74a4d2b203 req-5c615243-02d2-40ca-be42-49a47b8201f2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0750382 Nov 21 13:54:30.740615 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1e6fd19b-e9f0-4793-b332-1b74a4d2b203 req-7337c696-28fc-4dda-8f22-0a17a105cf4d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0502899 Nov 21 13:54:31.052322 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7affd1c-74c2-492e-9e13-74e8880ba494 req-f8c9104a-a324-479f-a3c9-f00292fecf98 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:31.054626 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b7affd1c-74c2-492e-9e13-74e8880ba494 req-f8c9104a-a324-479f-a3c9-f00292fecf98 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0588036 Nov 21 13:54:31.104881 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b7affd1c-74c2-492e-9e13-74e8880ba494 req-a89508ff-b9d2-4a05-b3b3-94fa0fa9ad40 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443265 Nov 21 13:54:31.911540 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec70cf9b-cef2-48b5-8337-a44ce2e03833 req-d201d04a-1ffa-4c85-81ff-9b68a5e84969 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:31.913070 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ec70cf9b-cef2-48b5-8337-a44ce2e03833 req-d201d04a-1ffa-4c85-81ff-9b68a5e84969 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0710752 Nov 21 13:54:31.980451 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ec70cf9b-cef2-48b5-8337-a44ce2e03833 req-43392282-c036-423d-83f8-37dff8c2b382 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0614018 Nov 21 13:54:32.231015 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a48d81b-fb32-4370-a821-9d991277b439 req-f1221ad9-c1b5-4e06-a06c-dec4e9db9f70 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:32.232553 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9a48d81b-fb32-4370-a821-9d991277b439 req-f1221ad9-c1b5-4e06-a06c-dec4e9db9f70 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0530634 Nov 21 13:54:32.308794 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9a48d81b-fb32-4370-a821-9d991277b439 req-95ef111d-6475-4596-9f6e-80775142fc65 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0680587 Nov 21 13:54:32.565000 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4e256e20-9100-4e35-95f1-3336375b594b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:33.158373 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b633e934-efb9-4207-a71f-b8760973fb6f req-f2fc9bce-7927-4722-9525-22a6d36d1e06 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:33.159769 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b633e934-efb9-4207-a71f-b8760973fb6f req-f2fc9bce-7927-4722-9525-22a6d36d1e06 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0886481 Nov 21 13:54:33.210310 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b633e934-efb9-4207-a71f-b8760973fb6f req-7530be01-d2e3-4199-b29a-88a1c8c6662f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495183 Nov 21 13:54:33.440217 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c836699-30e0-4e66-91aa-2cbb2153a792 req-b661d7f7-9b26-4f92-9cf4-14b925f68724 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:33.441805 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1c836699-30e0-4e66-91aa-2cbb2153a792 req-b661d7f7-9b26-4f92-9cf4-14b925f68724 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0566366 Nov 21 13:54:33.496368 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1c836699-30e0-4e66-91aa-2cbb2153a792 req-bc8260e5-3bc9-4130-8ee9-8ae1da93baae tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470984 Nov 21 13:54:33.863222 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:34.338541 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce52a88-c92d-4e68-9005-e79ffba09a5e req-3f8a25f6-ad2b-4d65-b8cd-1883cba2bf5f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:34.340041 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-cce52a88-c92d-4e68-9005-e79ffba09a5e req-3f8a25f6-ad2b-4d65-b8cd-1883cba2bf5f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0484543 Nov 21 13:54:34.388654 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-cce52a88-c92d-4e68-9005-e79ffba09a5e req-5b4466bd-96da-4a19-82a5-855a757a97d6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422714 Nov 21 13:54:34.611517 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91b0dcf4-4abc-4748-90c5-6e8b00240646 req-678422e4-6891-4e11-a677-63779c6a1c2a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:34.613043 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-91b0dcf4-4abc-4748-90c5-6e8b00240646 req-678422e4-6891-4e11-a677-63779c6a1c2a tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0482392 Nov 21 13:54:34.692029 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c064ec-a89d-4892-bded-74766d2b6d99 req-40ec5526-a039-425e-b40e-d98ddb164168 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:34.693999 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-06c064ec-a89d-4892-bded-74766d2b6d99 req-40ec5526-a039-425e-b40e-d98ddb164168 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 1099 time: 0.0800846 Nov 21 13:54:34.697778 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-91b0dcf4-4abc-4748-90c5-6e8b00240646 req-5a030a44-6abd-4d4c-9add-31085677e1fb tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761385 Nov 21 13:54:34.782435 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c064ec-a89d-4892-bded-74766d2b6d99 req-3e650519-14d0-4d9a-bb76-9e946c7e6dfe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:34.783897 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-06c064ec-a89d-4892-bded-74766d2b6d99 req-3e650519-14d0-4d9a-bb76-9e946c7e6dfe service neutron] 10.222.0.50 "GET /v2.0/networks?id=24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 200 len: 918 time: 0.0826139 Nov 21 13:54:34.851925 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-06c064ec-a89d-4892-bded-74766d2b6d99 req-3ed24eb2-27cc-4fd4-85b4-0bdf04b37a6e service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba HTTP/1.1" status: 200 len: 1002 time: 0.0598705 Nov 21 13:54:35.050568 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:35.137277 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c064ec-a89d-4892-bded-74766d2b6d99 req-aade1003-80e2-498f-b106-d0fbc267108b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:35.138709 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-06c064ec-a89d-4892-bded-74766d2b6d99 req-aade1003-80e2-498f-b106-d0fbc267108b service neutron] 10.222.0.50 "GET /v2.0/subnets?id=c4887ea6-9c0e-4a7b-bd51-d70b335ceb92 HTTP/1.1" status: 200 len: 856 time: 0.2783904 Nov 21 13:54:35.186769 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c064ec-a89d-4892-bded-74766d2b6d99 req-9aa1b674-554d-464f-a247-1c59efcbd155 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:35.188265 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-06c064ec-a89d-4892-bded-74766d2b6d99 req-9aa1b674-554d-464f-a247-1c59efcbd155 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=24c864ef-5c5a-4df8-8968-78a7fe30b188&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0387895 Nov 21 13:54:35.278867 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-06c064ec-a89d-4892-bded-74766d2b6d99 req-7fe429a1-8cdf-4648-963d-37241104feb0 service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832300 Nov 21 13:54:35.371034 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-06c064ec-a89d-4892-bded-74766d2b6d99 req-d37674a4-dd5e-46b1-9a49-94fe2e004b40 service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0840919 Nov 21 13:54:35.506801 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-220750f8-9ded-407f-b2ff-7fa22d64b443 req-8dd79f68-6466-4f65-97b7-c2d7bd51afd9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:35.508479 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-220750f8-9ded-407f-b2ff-7fa22d64b443 req-8dd79f68-6466-4f65-97b7-c2d7bd51afd9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0479739 Nov 21 13:54:35.516600 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 54018) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:35.555295 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-220750f8-9ded-407f-b2ff-7fa22d64b443 req-b7391232-208c-4107-b424-a3c77512dded tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408316 Nov 21 13:54:35.656579 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-22f84515-3d91-4ae1-ae80-f072bc3910ff admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:35.726362 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-22f84515-3d91-4ae1-ae80-f072bc3910ff admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:35.730434 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-22f84515-3d91-4ae1-ae80-f072bc3910ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:35.779769 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-22f84515-3d91-4ae1-ae80-f072bc3910ff admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=41e68d72531248b394fe042f77e27ffa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2620745 Nov 21 13:54:35.781834 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22f84515-3d91-4ae1-ae80-f072bc3910ff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=607c4a57-7bc3-4872-b2a3-bff3e9c4ed6f,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:35.782653 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54024) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:35.819873 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-031e570a-d7a8-40ab-8b0a-55cc561a0219 req-a562de1e-fba9-4fc5-8883-b36e6dbb27ee tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:35.821234 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-031e570a-d7a8-40ab-8b0a-55cc561a0219 req-a562de1e-fba9-4fc5-8883-b36e6dbb27ee tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0530465 Nov 21 13:54:35.839158 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9ad46a74-2b3e-4b22-94a8-fe88acb96c25 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:35.839405 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:35.862788 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9ad46a74-2b3e-4b22-94a8-fe88acb96c25 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:35.870772 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-031e570a-d7a8-40ab-8b0a-55cc561a0219 req-5e159e1f-9238-4342-809a-ddabf7853164 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422115 Nov 21 13:54:35.911517 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9ad46a74-2b3e-4b22-94a8-fe88acb96c25 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:35.914092 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9ad46a74-2b3e-4b22-94a8-fe88acb96c25 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:35.915214 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-9ad46a74-2b3e-4b22-94a8-fe88acb96c25 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/607c4a57-7bc3-4872-b2a3-bff3e9c4ed6f HTTP/1.1" status: 204 len: 168 time: 0.1315949 Nov 21 13:54:35.922974 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad46a74-2b3e-4b22-94a8-fe88acb96c25 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=607c4a57-7bc3-4872-b2a3-bff3e9c4ed6f,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:36.678354 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d9cbcfc-d9c3-4dff-a854-1141dbd5a7dd req-6bd5269f-ce7a-4948-98f2-b0e738c4d32d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:36.679843 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3d9cbcfc-d9c3-4dff-a854-1141dbd5a7dd req-6bd5269f-ce7a-4948-98f2-b0e738c4d32d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0525630 Nov 21 13:54:36.726327 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3d9cbcfc-d9c3-4dff-a854-1141dbd5a7dd req-e6fb6868-8d1c-4e71-8a36-5215f59efeab tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406687 Nov 21 13:54:36.994126 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8d67541-479a-4b1b-ac01-aa399858750b req-ce72f2c0-9735-4258-a4a4-c547f9a9d513 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:36.995644 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f8d67541-479a-4b1b-ac01-aa399858750b req-ce72f2c0-9735-4258-a4a4-c547f9a9d513 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0515876 Nov 21 13:54:37.044662 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f8d67541-479a-4b1b-ac01-aa399858750b req-bbf3a6aa-6c1a-48b2-bb8d-4978a145a3b5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410230 Nov 21 13:54:37.845884 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fe49014-d78b-4ac4-acf5-c42098d868aa req-22d53a98-91e4-4738-bed3-3b6fdb827a91 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:37.847344 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3fe49014-d78b-4ac4-acf5-c42098d868aa req-22d53a98-91e4-4738-bed3-3b6fdb827a91 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 946 time: 0.0500350 Nov 21 13:54:37.848573 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 627d561d-d2ff-449e-a99f-9e5e3fd874ba no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:54:37.894345 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3fe49014-d78b-4ac4-acf5-c42098d868aa req-3e4da5b4-3fab-47c1-9a61-0b3c1d0dfa3f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408492 Nov 21 13:54:38.048170 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:38.073702 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:54:38.076042 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a52e18cb-4a12-4aa5-ad3f-d8be47b55b23" -d '{"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-unplugged", "status": "completed", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:54:38.099911 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:54:38.111281 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:38.163236 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=627d561d-d2ff-449e-a99f-9e5e3fd874ba,revision_number=8']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:38.171502 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-326bf4fe-0f07-4ba3-8120-69c836ff2988 req-b1035384-6d74-46e7-b488-4866ae81ab8d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:38.177461 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-326bf4fe-0f07-4ba3-8120-69c836ff2988 req-b1035384-6d74-46e7-b488-4866ae81ab8d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0542450 Nov 21 13:54:38.228357 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-326bf4fe-0f07-4ba3-8120-69c836ff2988 req-c56f6b74-ffa5-4575-b04b-bbd95b014175 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486379 Nov 21 13:54:38.274329 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Sun, 21 Nov 2021 13:54:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d1a6cfb4-c773-4f09-9067-c3e921e08e05 x-openstack-request-id: req-d1a6cfb4-c773-4f09-9067-c3e921e08e05 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:54:38.274622 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-unplugged", "status": "failed", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba", "code": 422}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:54:38.274906 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-d1a6cfb4-c773-4f09-9067-c3e921e08e05 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:54:38.275316 dv-cinder-768458-12-iscsi neutron-server[109042]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'code': 422} returned with failed status Nov 21 13:54:38.465173 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [req-8276e33f-99fd-4bde-a52c-4c172cc19492 req-44f32a53-57ed-4c0a-a29f-da792768d937 service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109040) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 13:54:38.466196 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8276e33f-99fd-4bde-a52c-4c172cc19492 req-44f32a53-57ed-4c0a-a29f-da792768d937 service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0055170 Nov 21 13:54:38.624848 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40beb237-45b2-4161-ba79-1e37ca15e653 req-596d5ccd-b1c7-4082-afc7-763c6685e3d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:38.626706 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40beb237-45b2-4161-ba79-1e37ca15e653 req-596d5ccd-b1c7-4082-afc7-763c6685e3d8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0540328 Nov 21 13:54:38.678958 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40beb237-45b2-4161-ba79-1e37ca15e653 req-b3061a89-2778-407a-819b-1c986f0188cc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435915 Nov 21 13:54:38.913545 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54112) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:38.993715 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-b07f5208-303c-4eeb-b972-11ad47f0546f service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0790584 Nov 21 13:54:39.002623 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-9a31c47f-735c-4096-9469-43dc64757454 service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109040) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 13:54:39.003558 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-9a31c47f-735c-4096-9469-43dc64757454 service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049467 Nov 21 13:54:39.355212 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee25615-cfa9-45a9-8d1a-9910947c99ab req-9ef2b516-9c24-4011-b5c4-8a004d8bea2b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:39.356648 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1ee25615-cfa9-45a9-8d1a-9910947c99ab req-9ef2b516-9c24-4011-b5c4-8a004d8bea2b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0519140 Nov 21 13:54:39.405570 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1ee25615-cfa9-45a9-8d1a-9910947c99ab req-8b7da444-982c-4594-b262-9e33754617bf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422740 Nov 21 13:54:39.806073 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8aa1857-a6cc-4cf6-bd6f-8205ad945bfc req-8bcbe8b3-07f2-497a-9f5b-be28425b3f35 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:39.807697 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a8aa1857-a6cc-4cf6-bd6f-8205ad945bfc req-8bcbe8b3-07f2-497a-9f5b-be28425b3f35 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0510924 Nov 21 13:54:39.856223 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a8aa1857-a6cc-4cf6-bd6f-8205ad945bfc req-b7b4c2c2-1efd-442f-81f3-54fad5002053 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421054 Nov 21 13:54:40.479596 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-c7f57c49-033c-4bff-b570-3cfffd3e23cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:40.482002 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-c7f57c49-033c-4bff-b570-3cfffd3e23cf service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1&tenant_id=3d25ecbdc2ba435488271022d897a406 HTTP/1.1" status: 200 len: 1097 time: 0.0751023 Nov 21 13:54:40.529943 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-271309ab-8b4c-4db5-930e-4e214474b168 req-6e2f4c5c-a550-4f7e-948f-9fd6162f6734 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:40.531442 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-271309ab-8b4c-4db5-930e-4e214474b168 req-6e2f4c5c-a550-4f7e-948f-9fd6162f6734 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0508199 Nov 21 13:54:40.553633 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-dd60bd69-feff-4aa4-934a-aa9f39382455 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:40.555107 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-dd60bd69-feff-4aa4-934a-aa9f39382455 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 1097 time: 0.0406950 Nov 21 13:54:40.578515 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-271309ab-8b4c-4db5-930e-4e214474b168 req-9daa7d26-a64d-43a5-9948-09bb891b87a8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409231 Nov 21 13:54:40.653548 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-5869604e-d01f-4901-9057-342a0f0b159f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:40.655007 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-5869604e-d01f-4901-9057-342a0f0b159f service neutron] 10.222.0.50 "GET /v2.0/networks?id=24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 200 len: 918 time: 0.0890994 Nov 21 13:54:40.718790 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-94716511-3222-4f6a-ab00-edaad3816aa3 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba HTTP/1.1" status: 200 len: 1000 time: 0.0558681 Nov 21 13:54:40.769111 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-da44adf9-25ea-4a25-9cee-e86258a47afe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:40.770578 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-da44adf9-25ea-4a25-9cee-e86258a47afe service neutron] 10.222.0.50 "GET /v2.0/subnets?id=c4887ea6-9c0e-4a7b-bd51-d70b335ceb92 HTTP/1.1" status: 200 len: 856 time: 0.0433843 Nov 21 13:54:40.822737 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-9204c7bc-fc96-42e3-8c39-6f137382672a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:40.824228 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-9204c7bc-fc96-42e3-8c39-6f137382672a service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=24c864ef-5c5a-4df8-8968-78a7fe30b188&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0441513 Nov 21 13:54:40.916098 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-bc3cef5d-b0f4-4e9b-b969-705e407946a6 service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827801 Nov 21 13:54:41.045757 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716e3a29-a40d-48ba-b20c-b7d4a4a4642d req-b9068432-3ab6-4e8e-b248-bfb976e9464c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:41.047232 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-716e3a29-a40d-48ba-b20c-b7d4a4a4642d req-b9068432-3ab6-4e8e-b248-bfb976e9464c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.1139970 Nov 21 13:54:41.065153 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-844635e9-54fa-4d15-8ec2-20d01327f82b req-6e1e5ec7-9f55-4897-9578-907913b4197f service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1407850 Nov 21 13:54:41.103292 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-716e3a29-a40d-48ba-b20c-b7d4a4a4642d req-19e3a245-a875-459d-a9c4-d2b4a6dde832 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499976 Nov 21 13:54:41.752262 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d7458df-a9f4-4bec-8dc9-70e7dd49e644 req-04bb1cb8-44b6-4ca2-a02a-53a59b92032f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:41.759741 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-9d7458df-a9f4-4bec-8dc9-70e7dd49e644 req-04bb1cb8-44b6-4ca2-a02a-53a59b92032f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0621004 Nov 21 13:54:41.823905 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-9d7458df-a9f4-4bec-8dc9-70e7dd49e644 req-4f3fdcad-b530-4741-bf5c-5ae87a8a6921 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620999 Nov 21 13:54:41.893437 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 627d561d-d2ff-449e-a99f-9e5e3fd874ba no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:54:42.237582 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d8004c-c13b-4d93-a286-bcdc0e58b2c2 req-a1b7a53d-ee71-4352-8f45-5f99786ec511 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:42.239216 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f3d8004c-c13b-4d93-a286-bcdc0e58b2c2 req-a1b7a53d-ee71-4352-8f45-5f99786ec511 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0550992 Nov 21 13:54:42.293940 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f3d8004c-c13b-4d93-a286-bcdc0e58b2c2 req-4d95d819-21ac-4046-a07d-6e6e9c198fca tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486939 Nov 21 13:54:42.949927 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43e500c2-3d29-4822-b2af-930bfaf7ca43 req-7c9fea04-7e85-4e1d-9c4d-bbad864222f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:42.952543 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-43e500c2-3d29-4822-b2af-930bfaf7ca43 req-7c9fea04-7e85-4e1d-9c4d-bbad864222f4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0494225 Nov 21 13:54:43.013387 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-43e500c2-3d29-4822-b2af-930bfaf7ca43 req-b62738e7-fb09-41a5-9115-4fc215302e7c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524287 Nov 21 13:54:43.424378 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee1a91cb-5737-4286-b7b3-ad1e5c3511a4 req-d4f34fd5-ff5c-48eb-9d9d-6caa9ddc5704 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:43.426284 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ee1a91cb-5737-4286-b7b3-ad1e5c3511a4 req-d4f34fd5-ff5c-48eb-9d9d-6caa9ddc5704 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0549850 Nov 21 13:54:43.491337 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ee1a91cb-5737-4286-b7b3-ad1e5c3511a4 req-94f15214-1a05-4d18-9dcd-94846dc875aa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471966 Nov 21 13:54:44.147525 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5adacf4b-9d51-400b-843c-3ed4fb162324 req-b9beb5ae-81fa-492e-819e-1a1cfd2891f9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:44.149482 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5adacf4b-9d51-400b-843c-3ed4fb162324 req-b9beb5ae-81fa-492e-819e-1a1cfd2891f9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0515416 Nov 21 13:54:44.198903 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5adacf4b-9d51-400b-843c-3ed4fb162324 req-8cb8dba5-96cd-4b5c-bb53-f07a07561309 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433617 Nov 21 13:54:44.633774 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8301989a-17e5-47bf-8716-da08570bf14d req-bee8f899-9a5a-4ff8-8f4c-b030cfa2cb72 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:44.635174 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8301989a-17e5-47bf-8716-da08570bf14d req-bee8f899-9a5a-4ff8-8f4c-b030cfa2cb72 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0665350 Nov 21 13:54:44.690514 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8301989a-17e5-47bf-8716-da08570bf14d req-3440f4d3-2b42-40a1-8b1a-ee6307eeb601 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487061 Nov 21 13:54:45.323119 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cedb2c7f-251d-4f66-a76e-ab756fa06f93 req-461ccc9a-ee81-44b5-94a7-4ba553955a2c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:45.324675 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-cedb2c7f-251d-4f66-a76e-ab756fa06f93 req-461ccc9a-ee81-44b5-94a7-4ba553955a2c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0558879 Nov 21 13:54:45.371530 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-cedb2c7f-251d-4f66-a76e-ab756fa06f93 req-17e78870-b350-47d3-9491-3f85a8dd46f3 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409060 Nov 21 13:54:45.815883 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8037cdc2-20f8-4573-8e64-468caf5c9ca5 req-afc354ed-fefc-4f1f-9fe3-272ce42965ad tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:45.817950 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8037cdc2-20f8-4573-8e64-468caf5c9ca5 req-afc354ed-fefc-4f1f-9fe3-272ce42965ad tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0526977 Nov 21 13:54:45.869039 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8037cdc2-20f8-4573-8e64-468caf5c9ca5 req-1e314730-fb69-43af-b949-a862fd1c7af0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443296 Nov 21 13:54:46.491364 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1b8f57-fe3c-4885-b8d7-d98413efb0c7 req-ebb1c01a-844f-48ee-af3f-8776945d062e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:46.492914 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-da1b8f57-fe3c-4885-b8d7-d98413efb0c7 req-ebb1c01a-844f-48ee-af3f-8776945d062e tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0509245 Nov 21 13:54:46.546863 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-da1b8f57-fe3c-4885-b8d7-d98413efb0c7 req-0545805d-8d67-4e78-959e-cb70daeb75db tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478640 Nov 21 13:54:46.774301 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54270) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:46.899202 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d8cb4d07-885a-42a0-bf53-0fdcda2b2d6c admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:46.979977 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d8cb4d07-885a-42a0-bf53-0fdcda2b2d6c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:47.000317 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d8cb4d07-885a-42a0-bf53-0fdcda2b2d6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:47.024045 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd5d3730-fb19-47c0-9317-5accb11581f0 req-5f4b9089-27ef-4fed-a44a-52c32fdc868a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:47.026565 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-cd5d3730-fb19-47c0-9317-5accb11581f0 req-5f4b9089-27ef-4fed-a44a-52c32fdc868a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0771000 Nov 21 13:54:47.047138 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-d8cb4d07-885a-42a0-bf53-0fdcda2b2d6c admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=8e24ab2ed3d2435e85e77dcb7fd632e7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2713931 Nov 21 13:54:47.047974 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54276) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:47.048645 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8cb4d07-885a-42a0-bf53-0fdcda2b2d6c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c793d19-112f-43fb-821c-7ec6c8ba6c4a,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:47.101055 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-cd5d3730-fb19-47c0-9317-5accb11581f0 req-7e433753-f319-4256-a30c-fd400af376d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0665863 Nov 21 13:54:47.111682 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-481962ae-fd2f-4598-9e7f-aa8a52e83fe6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:47.139911 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-481962ae-fd2f-4598-9e7f-aa8a52e83fe6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:47.189744 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-481962ae-fd2f-4598-9e7f-aa8a52e83fe6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:47.193036 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-481962ae-fd2f-4598-9e7f-aa8a52e83fe6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:47.194171 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-481962ae-fd2f-4598-9e7f-aa8a52e83fe6 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0c793d19-112f-43fb-821c-7ec6c8ba6c4a HTTP/1.1" status: 204 len: 168 time: 0.1419683 Nov 21 13:54:47.202663 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-481962ae-fd2f-4598-9e7f-aa8a52e83fe6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c793d19-112f-43fb-821c-7ec6c8ba6c4a,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:47.678587 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba830f07-eb1c-45dc-b956-7922362aa2e5 req-8b79dd5d-cd47-4a68-9220-713e3b353aef tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:47.680087 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ba830f07-eb1c-45dc-b956-7922362aa2e5 req-8b79dd5d-cd47-4a68-9220-713e3b353aef tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0545948 Nov 21 13:54:47.757552 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ba830f07-eb1c-45dc-b956-7922362aa2e5 req-bdbc9be4-db44-412b-b1c9-b5893f2d38c9 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689902 Nov 21 13:54:48.247740 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd49f4fe-aa2a-4d53-b358-729b9c08d1bf req-f0979a16-9a6c-4b6b-a148-31d53a76e87d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:48.249266 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bd49f4fe-aa2a-4d53-b358-729b9c08d1bf req-f0979a16-9a6c-4b6b-a148-31d53a76e87d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0619528 Nov 21 13:54:48.306628 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bd49f4fe-aa2a-4d53-b358-729b9c08d1bf req-48ec7e5a-33a4-4184-8e3d-b7b373f5d6c9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511687 Nov 21 13:54:48.616311 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:54:48.879457 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-924ddb1f-f0c6-4ccb-bc7f-ea122bd1b176 req-7f90aa4d-7465-4470-840d-a8af5bf67c88 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:48.882728 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-924ddb1f-f0c6-4ccb-bc7f-ea122bd1b176 req-7f90aa4d-7465-4470-840d-a8af5bf67c88 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0525062 Nov 21 13:54:48.929962 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-924ddb1f-f0c6-4ccb-bc7f-ea122bd1b176 req-cac846b0-c9c6-47d7-8aa3-2f866bfb8a6d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419390 Nov 21 13:54:49.425479 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6a8dc74-511f-4538-b9bd-4c6f0c191d75 req-326ae0b7-731d-41ac-9160-5cc5f2cf37ce tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:49.427458 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b6a8dc74-511f-4538-b9bd-4c6f0c191d75 req-326ae0b7-731d-41ac-9160-5cc5f2cf37ce tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0497177 Nov 21 13:54:49.488430 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b6a8dc74-511f-4538-b9bd-4c6f0c191d75 req-d340c5ad-a206-483e-b82e-7b538e146571 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0549686 Nov 21 13:54:50.052093 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf235089-29eb-48cf-8fb9-8b32dd05094a req-2b593998-fab8-4ca3-94ec-cd6e7126bc06 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:50.053882 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-cf235089-29eb-48cf-8fb9-8b32dd05094a req-2b593998-fab8-4ca3-94ec-cd6e7126bc06 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0572133 Nov 21 13:54:50.104089 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-cf235089-29eb-48cf-8fb9-8b32dd05094a req-74dfc944-f652-494d-a734-8d20479b9062 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442674 Nov 21 13:54:50.612750 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68f15827-6faa-4699-8543-46e72387bd67 req-525759ab-da4a-475f-bcfa-e0b56840f8d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:50.614127 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-68f15827-6faa-4699-8543-46e72387bd67 req-525759ab-da4a-475f-bcfa-e0b56840f8d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0488029 Nov 21 13:54:50.669124 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-68f15827-6faa-4699-8543-46e72387bd67 req-684e5109-19ce-4a5a-a6da-788069f49133 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473802 Nov 21 13:54:51.236584 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97cddd29-4d70-4487-aa24-18bfbbbdc4aa req-b287e7b9-df36-4071-9a29-00ea8d9d2840 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:51.238247 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-97cddd29-4d70-4487-aa24-18bfbbbdc4aa req-b287e7b9-df36-4071-9a29-00ea8d9d2840 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0540152 Nov 21 13:54:51.290443 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-97cddd29-4d70-4487-aa24-18bfbbbdc4aa req-d61edc70-9cae-4dd2-957f-c4348790d28b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455031 Nov 21 13:54:51.810536 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc3f1385-e47e-4646-aace-094d172421b2 req-9f89a34b-10ed-4ec2-864e-8c3ca8f737ac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:51.812148 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bc3f1385-e47e-4646-aace-094d172421b2 req-9f89a34b-10ed-4ec2-864e-8c3ca8f737ac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0508144 Nov 21 13:54:51.860263 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bc3f1385-e47e-4646-aace-094d172421b2 req-7dbaa14b-f299-4ae9-9736-cba1e50815b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420380 Nov 21 13:54:52.415766 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-031b1cb1-6b9f-45d4-82c7-3152da67cd85 req-e58c090f-cf24-4b05-9d1e-a564b40d9723 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:52.417666 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-031b1cb1-6b9f-45d4-82c7-3152da67cd85 req-e58c090f-cf24-4b05-9d1e-a564b40d9723 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0584378 Nov 21 13:54:52.466713 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-031b1cb1-6b9f-45d4-82c7-3152da67cd85 req-a5de9c01-2a23-4737-bc3d-2f277ad98e0f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428960 Nov 21 13:54:52.542188 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:52.983025 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e318dbbf-0cea-45d1-99c0-f7184fad4911 req-308f4c05-c39c-4d17-9380-a8c877c69fba tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:52.984665 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e318dbbf-0cea-45d1-99c0-f7184fad4911 req-308f4c05-c39c-4d17-9380-a8c877c69fba tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0523164 Nov 21 13:54:53.032549 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e318dbbf-0cea-45d1-99c0-f7184fad4911 req-000ed74b-01c5-4742-8250-dcfa5adab01c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406089 Nov 21 13:54:53.581364 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-039fbbc2-507b-48f4-8c65-9eb725e87811 req-cbfc3365-4115-4fed-b9af-8316d000b21b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:53.583373 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-039fbbc2-507b-48f4-8c65-9eb725e87811 req-cbfc3365-4115-4fed-b9af-8316d000b21b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0478795 Nov 21 13:54:53.635223 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-039fbbc2-507b-48f4-8c65-9eb725e87811 req-8ced24da-032e-443c-b65b-017caa53b3e0 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459390 Nov 21 13:54:53.968159 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74255bcc-3658-4c9a-9abb-f3839084e43a req-348c4585-8a27-491a-83ab-137882b66f31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:53.969635 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-74255bcc-3658-4c9a-9abb-f3839084e43a req-348c4585-8a27-491a-83ab-137882b66f31 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 1097 time: 0.0650456 Nov 21 13:54:53.972070 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b86c0b0e-8c76-4ed7-ad9d-ead092157fbf req-2fdc48db-fc3a-4a3f-9466-f05d50174593 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:53.973535 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b86c0b0e-8c76-4ed7-ad9d-ead092157fbf req-2fdc48db-fc3a-4a3f-9466-f05d50174593 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 1098 time: 0.0771091 Nov 21 13:54:54.094994 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b86c0b0e-8c76-4ed7-ad9d-ead092157fbf req-8315d468-5e43-453b-b79f-d1f34d443f86 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1005402 Nov 21 13:54:54.126913 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74255bcc-3658-4c9a-9abb-f3839084e43a req-44511838-60eb-42ca-b72f-cc16acd6ac8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:54.128360 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-74255bcc-3658-4c9a-9abb-f3839084e43a req-44511838-60eb-42ca-b72f-cc16acd6ac8f service neutron] 10.222.0.50 "GET /v2.0/networks?id=24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 200 len: 918 time: 0.1330318 Nov 21 13:54:54.163352 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a292cd5c-9a33-4236-a06c-4165c32e7379 req-d28fc56b-2e05-494b-93be-7b68de318775 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:54.164898 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a292cd5c-9a33-4236-a06c-4165c32e7379 req-d28fc56b-2e05-494b-93be-7b68de318775 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0523529 Nov 21 13:54:54.210837 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a292cd5c-9a33-4236-a06c-4165c32e7379 req-a6c8c3fd-f90a-428a-aaa0-fbbc3c5fb282 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401485 Nov 21 13:54:54.380554 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-74255bcc-3658-4c9a-9abb-f3839084e43a req-35a36782-396d-47eb-b468-d2e8f79f0f7d service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba HTTP/1.1" status: 200 len: 1000 time: 0.0656991 Nov 21 13:54:54.433932 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74255bcc-3658-4c9a-9abb-f3839084e43a req-dd214a50-dd5d-48ba-a407-39bf4f6fd6a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:54.435318 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-74255bcc-3658-4c9a-9abb-f3839084e43a req-dd214a50-dd5d-48ba-a407-39bf4f6fd6a5 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=c4887ea6-9c0e-4a7b-bd51-d70b335ceb92 HTTP/1.1" status: 200 len: 856 time: 0.0428104 Nov 21 13:54:54.480444 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74255bcc-3658-4c9a-9abb-f3839084e43a req-81440cdb-e852-4d08-833f-7364d794c7d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:54.481856 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-74255bcc-3658-4c9a-9abb-f3839084e43a req-81440cdb-e852-4d08-833f-7364d794c7d5 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=24c864ef-5c5a-4df8-8968-78a7fe30b188&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0385613 Nov 21 13:54:54.596969 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-74255bcc-3658-4c9a-9abb-f3839084e43a req-e74b81a7-1b24-4ebb-8787-970ba5c825a1 service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814342 Nov 21 13:54:54.690999 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-74255bcc-3658-4c9a-9abb-f3839084e43a req-21152fda-d828-4520-a712-e434826260de service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844963 Nov 21 13:54:54.754225 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9b26f2-99e9-4e97-8f20-e38d39d25f6d req-c829e6d5-4a51-41ad-bce2-ed1ca7c65a0f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:54.755687 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5b9b26f2-99e9-4e97-8f20-e38d39d25f6d req-c829e6d5-4a51-41ad-bce2-ed1ca7c65a0f tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0517523 Nov 21 13:54:54.802724 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5b9b26f2-99e9-4e97-8f20-e38d39d25f6d req-e3d7269c-a3f4-4c98-ae3b-8ecf62e0eaad tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409048 Nov 21 13:54:55.357701 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7875a0-d4d1-454d-b658-2aff61f33ae3 req-7526095c-98d6-405d-a819-de0927a72583 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:55.359294 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ca7875a0-d4d1-454d-b658-2aff61f33ae3 req-7526095c-98d6-405d-a819-de0927a72583 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0526531 Nov 21 13:54:55.408016 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ca7875a0-d4d1-454d-b658-2aff61f33ae3 req-ce5d6cd1-950a-4209-b2bf-9284ec6e1f98 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423205 Nov 21 13:54:55.916654 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eefecec9-cebf-4a84-a7b7-b1b5d3834094 req-81bcfec5-b898-4ec9-905c-61996a17ba4b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:55.918142 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-eefecec9-cebf-4a84-a7b7-b1b5d3834094 req-81bcfec5-b898-4ec9-905c-61996a17ba4b tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0481019 Nov 21 13:54:55.964827 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-eefecec9-cebf-4a84-a7b7-b1b5d3834094 req-b850bbc6-0e4b-4276-97d9-ab0bac67ca26 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409110 Nov 21 13:54:56.304159 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54398) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:56.338419 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 req-ea1dff5f-01e1-4423-a65c-90911d2760b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:56.340317 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 req-ea1dff5f-01e1-4423-a65c-90911d2760b9 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=c90104f2696540809e93549d7ed3695f&device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 1098 time: 0.0763514 Nov 21 13:54:56.349778 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ed191a2-e63f-40ad-b8ba-54731279cf0a req-b57aa819-1fce-481e-9fce-b4aea2cd5c63 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:56.351222 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0ed191a2-e63f-40ad-b8ba-54731279cf0a req-b57aa819-1fce-481e-9fce-b4aea2cd5c63 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0769722 Nov 21 13:54:56.400504 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0ed191a2-e63f-40ad-b8ba-54731279cf0a req-6046cf52-d545-4fb7-914b-e5df03ddbf75 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419319 Nov 21 13:54:56.421484 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:56.497739 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 req-8f3e3e0c-897e-4b0d-b76c-2421bd461953 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:56.499202 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 req-8f3e3e0c-897e-4b0d-b76c-2421bd461953 service neutron] 10.222.0.50 "GET /v2.0/networks?id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a HTTP/1.1" status: 200 len: 919 time: 0.0912998 Nov 21 13:54:56.519585 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:56.526967 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:56.543864 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 req-b8ea5f2d-8a04-4731-b7a0-b2da2d141e3a service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 HTTP/1.1" status: 200 len: 217 time: 0.0340555 Nov 21 13:54:56.576282 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-764d0fb0-7644-420f-b108-3f19b3c18839 req-6bb0cc37-07cd-47de-ba96-5063e3920832 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:56.577751 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-764d0fb0-7644-420f-b108-3f19b3c18839 req-6bb0cc37-07cd-47de-ba96-5063e3920832 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0929062 Nov 21 13:54:56.579315 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4d43229-0c1d-4eb1-9090-adacbc48ef4f,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:56.582675 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=686e5bddedb944c4a97f88e5a0a707e8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2774789 Nov 21 13:54:56.585489 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 54404) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:56.594038 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.594319 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.594657 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.594987 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.595319 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.595648 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.596001 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.596330 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.596655 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.596976 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.597294 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.597608 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f1a66f4-f5eb-4edb-91c7-bf341584b5d9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.606308 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 req-0d5addd0-41aa-441e-b9de-da08161703a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:56.607736 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 req-0d5addd0-41aa-441e-b9de-da08161703a1 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=a7f1c544-97e5-450d-9032-daf1d5a3a2a3 HTTP/1.1" status: 200 len: 858 time: 0.0563858 Nov 21 13:54:56.639048 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-764d0fb0-7644-420f-b108-3f19b3c18839 req-b2f8a706-1f93-4c66-9f95-9f8da3e207d6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0543444 Nov 21 13:54:56.647823 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 req-30f50283-7877-4c18-b6fc-246f9888868b service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0316739 Nov 21 13:54:56.708599 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:56.740815 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:56.782864 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 req-89261ea5-6e89-476c-a555-e7dffbdeb344 service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1271241 Nov 21 13:54:56.844577 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:56.847089 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:56.848839 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/d4d43229-0c1d-4eb1-9090-adacbc48ef4f HTTP/1.1" status: 204 len: 168 time: 0.2624230 Nov 21 13:54:56.863796 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4d43229-0c1d-4eb1-9090-adacbc48ef4f,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:56.879504 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.879881 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.880231 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.880571 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.880907 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.881243 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.881576 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.881909 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.882237 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.882561 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.882887 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.883210 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c3f7369-c246-46e6-8fd2-021e7e12872f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:54:56.903247 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e88e8cc5-5d53-4e9c-bc72-5aeef515d556 req-8165fd6a-3d17-417e-b1f5-9fa987bfcd2f service neutron] 10.222.0.50 "GET /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1114941 Nov 21 13:54:57.459828 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 54428) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:57.522299 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c71305d9-b94b-4c47-ac3f-22d30da12558 req-925af806-df80-4cbf-b934-46ef5e669ddf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:57.523757 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c71305d9-b94b-4c47-ac3f-22d30da12558 req-925af806-df80-4cbf-b934-46ef5e669ddf tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0479822 Nov 21 13:54:57.558807 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-155017918-network', 'tenant_id': '406bef8592334a749f671da6881b0cf5'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:54:57.583835 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c71305d9-b94b-4c47-ac3f-22d30da12558 req-4c049456-611f-4b53-a2d5-b9a254a9e833 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537555 Nov 21 13:54:57.592091 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Made reservation on behalf of 406bef8592334a749f671da6881b0cf5 for: {'network': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:54:57.594414 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:57.607701 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:57.678863 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:57.682970 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:57.702640 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] vlan segment allocate from pool success with {'vlan_id': 504, 'physical_network': 'physnet1'} {{(pid=109041) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:54:57.716268 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dcfd3018-6236-44ab-a1ee-abdf37bb89a5,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:57.720925 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:57.721274 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.segments_db [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Added segment 4b6f9b23-2ba5-4aaf-ba35-6a043045eacf of type vlan for network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 Nov 21 13:54:57.761242 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:57.765516 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-803aeb5d-8669-4cc5-89c8-428c144725f7 req-1e0c9721-a15d-4c14-a08d-475a07319de8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:57.767204 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-803aeb5d-8669-4cc5-89c8-428c144725f7 req-1e0c9721-a15d-4c14-a08d-475a07319de8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0535021 Nov 21 13:54:57.786511 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:57.787500 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:57.788141 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:57.816457 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-803aeb5d-8669-4cc5-89c8-428c144725f7 req-147c10be-c13c-4ea4-9886-2aaed22d691e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428267 Nov 21 13:54:57.843894 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3829088 Nov 21 13:54:57.846718 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 54436) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:57.854262 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-26ea3e04-bff7-4fc0-bc66-26a12e023bf6 admin admin] Request body: {'subnet': {'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-155017918-subnet', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:54:57.858453 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f0fce31-b2fb-48db-8398-c1e7ed5be4ad admin admin] Pushing event updated for resources: {'Network': ['ID=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:57.868036 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:54:57.877672 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-26ea3e04-bff7-4fc0-bc66-26a12e023bf6 admin admin] Made reservation on behalf of 406bef8592334a749f671da6881b0cf5 for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:54:57.880251 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-26ea3e04-bff7-4fc0-bc66-26a12e023bf6 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-261005224'] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.042894 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-26ea3e04-bff7-4fc0-bc66-26a12e023bf6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3086915', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-261005206'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.100006 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26ea3e04-bff7-4fc0-bc66-26a12e023bf6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7cdb43d5-ad8a-4fcf-8b29-113b86f21514,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:58.108540 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26ea3e04-bff7-4fc0-bc66-26a12e023bf6 admin admin] Checking segment: {'id': '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:54:58.108846 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26ea3e04-bff7-4fc0-bc66-26a12e023bf6 admin admin] Network hostable DHCP agents. Network: 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:54:58.124389 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26ea3e04-bff7-4fc0-bc66-26a12e023bf6 admin admin] Network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:54:58.133224 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-26ea3e04-bff7-4fc0-bc66-26a12e023bf6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:54:58.137437 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26ea3e04-bff7-4fc0-bc66-26a12e023bf6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:58.138035 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-26ea3e04-bff7-4fc0-bc66-26a12e023bf6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.142328 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2a7f579-0cc6-4e52-9836-7a93038b42fe None None] Network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:54:58.155351 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-26ea3e04-bff7-4fc0-bc66-26a12e023bf6 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3073914 Nov 21 13:54:58.158007 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 54438) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:54:58.162092 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:54:58.181193 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-408660', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-58304'] for router, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.182179 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-473172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-468334', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1610115', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-58419'] for router, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.234817 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.290452 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6b3ed262-49ce-5e18-b10a-0ddd25bea067-34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'fixed_ips': [{'subnet_id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514'}]}} from dv-cinder-768458-12-iscsi. {{(pid=109042) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 21 13:54:58.291352 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.371093 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.424544 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.db_base_plugin_common [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Allocated IP 172.20.0.2 (34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9/7cdb43d5-ad8a-4fcf-8b29-113b86f21514/22d2f290-de3d-4780-8579-ec2027409661) {{(pid=109042) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:54:58.559444 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.565493 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Publish callbacks [] for port, precommit_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.571649 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.580978 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.611855 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 is already hosted by enough agents. {{(pid=109042) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:54:58.615331 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.base_scheduler [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Resources bound (agent type, host, resource id): {{(pid=109042) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:54:58.618703 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Received port after_create {{(pid=109042) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:54:58.626107 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Pushing event updated for resources: {'Port': ['ID=22d2f290-de3d-4780-8579-ec2027409661,revision_number=1']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:58.680183 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Attempting to bind port 22d2f290-de3d-4780-8579-ec2027409661 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:54:58.680555 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Attempting to bind port 22d2f290-de3d-4780-8579-ec2027409661 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:54:58.681240 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Attempting to bind port 22d2f290-de3d-4780-8579-ec2027409661 on network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:54:58.689313 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 54, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:54:58.689769 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Checking segment: {'id': '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:54:58.690174 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.690647 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Bound using segment: {'id': '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:54:58.691214 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Bound port: 22d2f290-de3d-4780-8579-ec2027409661, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:54:58.691632 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.731058 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Allocated IP 172.27.1.38 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/7c4354f0-0c69-4a70-b082-dcc2a2112ad7) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:54:58.755976 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ca4976e-a545-4ce5-b6f6-14e256176156 req-d18a886d-122b-4b67-ba6c-841dbafadec7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:58.756804 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] For port 22d2f290-de3d-4780-8579-ec2027409661, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:54:58.757473 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6ca4976e-a545-4ce5-b6f6-14e256176156 req-d18a886d-122b-4b67-ba6c-841dbafadec7 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0855241 Nov 21 13:54:58.760446 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] For port 22d2f290-de3d-4780-8579-ec2027409661, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=22d2f290-de3d-4780-8579-ec2027409661,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:54:58.765308 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.828387 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5309a528-fee4-4efd-a8f0-1d7cd9b52ba3 None None] Pushing event updated for resources: {'Port': ['ID=22d2f290-de3d-4780-8579-ec2027409661,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:58.867711 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6ca4976e-a545-4ce5-b6f6-14e256176156 req-3cac3340-515a-4fd7-aeec-c63f5eae1f99 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1014426 Nov 21 13:54:58.898206 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.936348 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:58.951894 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9384d3af-f1b9-4e12-be1a-e0b882f4e62a req-52a59885-4013-4372-adba-5aa2cbe86d7e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:54:58.953542 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-9384d3af-f1b9-4e12-be1a-e0b882f4e62a req-52a59885-4013-4372-adba-5aa2cbe86d7e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0527878 Nov 21 13:54:58.977098 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:54:58.980412 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:54:58.983435 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:54:59.007384 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-9384d3af-f1b9-4e12-be1a-e0b882f4e62a req-3e82f3c5-6501-4160-be62-2251cd5ddc25 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477786 Nov 21 13:54:59.024447 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Pushing event updated for resources: {'Port': ['ID=7c4354f0-0c69-4a70-b082-dcc2a2112ad7,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:54:59.256921 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:59.691262 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-473263', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-468275'] for router, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:59.777872 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44b1f5f5-6fb4-4467-ab1e-57dea0c93e92 None None] Network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:54:59.821151 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Router 97eb221f-bbef-4cab-b393-a7606b8c7477 is scheduled to L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 with binding_index 1 {{(pid=109041) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 21 13:54:59.867715 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-04281571-81c6-44f0-82c0-521fbfdb1860 None None] Provisioning complete for port 22d2f290-de3d-4780-8579-ec2027409661 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:54:59.868113 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-04281571-81c6-44f0-82c0-521fbfdb1860 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:59.930222 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:54:59.945467 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Sync routers for ids ['97eb221f-bbef-4cab-b393-a7606b8c7477'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:54:59.958096 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Routers {'97eb221f-bbef-4cab-b393-a7606b8c7477'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:54:59.958970 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] Publish callbacks [] for router, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:54:59.959117 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:54:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['97eb221f-bbef-4cab-b393-a7606b8c7477'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:54:59.963095 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-7bdc41e9-aefe-4b32-9b2e-dfbce4ad6f33 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 1.8015299 Nov 21 13:54:59.964265 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54446) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:00.005231 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-04281571-81c6-44f0-82c0-521fbfdb1860 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.011959 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efcb8818-0136-41f7-b80b-b4b14984702c req-161adb5c-8788-4caa-a3a3-13e35423defe tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:00.013489 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-efcb8818-0136-41f7-b80b-b4b14984702c req-161adb5c-8788-4caa-a3a3-13e35423defe tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0704410 Nov 21 13:55:00.044032 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-04281571-81c6-44f0-82c0-521fbfdb1860 None None] For port 22d2f290-de3d-4780-8579-ec2027409661, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=22d2f290-de3d-4780-8579-ec2027409661,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:00.052036 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-04281571-81c6-44f0-82c0-521fbfdb1860 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.089339 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-efcb8818-0136-41f7-b80b-b4b14984702c req-f8ee4d45-81ce-49a1-ad4b-25aab8b727a5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690014 Nov 21 13:55:00.103374 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Set router 97eb221f-bbef-4cab-b393-a7606b8c7477 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:00.173776 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04281571-81c6-44f0-82c0-521fbfdb1860 None None] Pushing event updated for resources: {'Port': ['ID=22d2f290-de3d-4780-8579-ec2027409661,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:00.182257 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8ea2c9c1-270c-4634-aee4-e3d728003b4a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.300114 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51157728-df65-4865-8f13-8fe6104955a4 req-d67efd60-36a7-414c-b6da-822634b9a918 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:00.302554 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-51157728-df65-4865-8f13-8fe6104955a4 req-d67efd60-36a7-414c-b6da-822634b9a918 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.1398385 Nov 21 13:55:00.368844 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-51157728-df65-4865-8f13-8fe6104955a4 req-7ed5d724-9be8-4b14-93aa-a8334f34ff02 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0585177 Nov 21 13:55:00.396810 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38'}], 'enable_snat': True}, 'gw_port_id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:54:59Z', 'revision_number': 3, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port': {'id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:b6:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:54:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:00.401152 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-106dd438-070c-414b-b7f7-097985ab08a5 None None] Provisioning complete for port 22d2f290-de3d-4780-8579-ec2027409661 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:00.401776 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-106dd438-070c-414b-b7f7-097985ab08a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.428731 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Checking router: 97eb221f-bbef-4cab-b393-a7606b8c7477 for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:55:00.429557 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Updating router 97eb221f-bbef-4cab-b393-a7606b8c7477 port 7c4354f0-0c69-4a70-b082-dcc2a2112ad7 binding host dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:55:00.439162 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 22d2f290-de3d-4780-8579-ec2027409661 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:55:00.456789 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.537380 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 22d2f290-de3d-4780-8579-ec2027409661 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:00.537982 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.629246 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.758546 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Publish callbacks [] for port, precommit_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.763977 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.803492 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Allocated IP 172.20.0.1 (34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9/7cdb43d5-ad8a-4fcf-8b29-113b86f21514/d03b886a-1564-44d9-a5a2-34ff7929ef4b) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:55:00.897762 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Attempting to bind port 7c4354f0-0c69-4a70-b082-dcc2a2112ad7 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:55:00.898137 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Attempting to bind port 7c4354f0-0c69-4a70-b082-dcc2a2112ad7 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:55:00.898502 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Attempting to bind port 7c4354f0-0c69-4a70-b082-dcc2a2112ad7 on network 67069811-a3d5-4953-8a57-e62d44750fe3 {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:55:00.905655 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Pushing event updated for resources: {'Port': ['ID=7c4354f0-0c69-4a70-b082-dcc2a2112ad7,revision_number=2']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:00.908628 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 54, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:55:00.909000 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Checking segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109043) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:55:00.909274 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.909380 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.909778 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Bound using segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:55:00.910856 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Bound port: 7c4354f0-0c69-4a70-b082-dcc2a2112ad7, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:55:00.911267 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.917353 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:00.917718 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:00.918066 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:00.918404 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:00.918737 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:00.919082 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:00.919418 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:00.919753 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:00.920107 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:00.920435 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:00.920761 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:00.921084 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:00.942579 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.971887 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] For port 7c4354f0-0c69-4a70-b082-dcc2a2112ad7, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109043) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:55:00.975252 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] For port 7c4354f0-0c69-4a70-b082-dcc2a2112ad7, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=7c4354f0-0c69-4a70-b082-dcc2a2112ad7,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109043) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:55:00.978856 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:00.983977 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:55:00.986817 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:55:00.990412 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:55:00.990871 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-470894'] for router_interface, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:01.028160 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Routers {'97eb221f-bbef-4cab-b393-a7606b8c7477'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:55:01.028607 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:54:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['97eb221f-bbef-4cab-b393-a7606b8c7477'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:01.028789 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Pushing event updated for resources: {'Port': ['ID=d03b886a-1564-44d9-a5a2-34ff7929ef4b,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:01.085613 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cc91b13-0396-43b9-8894-996479ff559d None None] Pushing event updated for resources: {'Port': ['ID=7c4354f0-0c69-4a70-b082-dcc2a2112ad7,revision_number=3']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:01.141155 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:01.161853 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] Set router 97eb221f-bbef-4cab-b393-a7606b8c7477 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:01.219522 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-994e3a45-2c00-48ea-84d9-5c5834cc8769 None None] Provisioning complete for port d03b886a-1564-44d9-a5a2-34ff7929ef4b triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:01.220643 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-994e3a45-2c00-48ea-84d9-5c5834cc8769 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:01.255519 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-994e3a45-2c00-48ea-84d9-5c5834cc8769 None None] Port d03b886a-1564-44d9-a5a2-34ff7929ef4b cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:55:01.329842 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:01.334784 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:01.335648 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1684480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-473342'] for router_interface, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:01.354383 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38'}], 'enable_snat': True}, 'gw_port_id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:54:59Z', 'revision_number': 3, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port': {'id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:b6:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:01.381211 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16de3095-4ee0-43a2-b343-1fbfb9444510 None None] The sync data for ids ['97eb221f-bbef-4cab-b393-a7606b8c7477'] in dv-cinder-768458-12-iscsi is: [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38'}], 'enable_snat': True}, 'gw_port_id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:54:59Z', 'revision_number': 3, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port': {'id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:b6:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:55:01.414470 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Pushing event updated for resources: {'Port': ['ID=d03b886a-1564-44d9-a5a2-34ff7929ef4b,revision_number=2']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:01.493655 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:55:01.495415 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:55:01.532365 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4db91170-f1fc-4e58-ba34-4cb0d59de3cd req-27f51f03-0963-4c29-b3d8-6be9fc1db1ee tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:01.534038 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4db91170-f1fc-4e58-ba34-4cb0d59de3cd req-27f51f03-0963-4c29-b3d8-6be9fc1db1ee tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 944 time: 0.0636091 Nov 21 13:55:01.599193 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4db91170-f1fc-4e58-ba34-4cb0d59de3cd req-1760baa2-b06f-45c7-b628-9cdeba94895c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0588841 Nov 21 13:55:01.678462 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Router 97eb221f-bbef-4cab-b393-a7606b8c7477 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:55:01.807455 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-1d480065-d81f-4499-878d-546fb2d7c4e4 None None] Provisioning complete for port d03b886a-1564-44d9-a5a2-34ff7929ef4b triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:01.809826 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-1d480065-d81f-4499-878d-546fb2d7c4e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:01.825489 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:55:01.831485 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-3d707988-5294-496b-8f50-1488963f3cee admin admin] 10.222.0.11 "PUT /v2.0/routers/97eb221f-bbef-4cab-b393-a7606b8c7477/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8649962 Nov 21 13:55:01.901144 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-1d480065-d81f-4499-878d-546fb2d7c4e4 None None] Port d03b886a-1564-44d9-a5a2-34ff7929ef4b cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:55:02.025392 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 627d561d-d2ff-449e-a99f-9e5e3fd874ba details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:55:02.154998 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:02.173463 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'port_id': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'mac_address': 'fa:16:3e:1c:94:81', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 524, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:55:02.221374 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.244167 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 627d561d-d2ff-449e-a99f-9e5e3fd874ba {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:55:02.294102 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:02.299692 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.340173 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 7c4354f0-0c69-4a70-b082-dcc2a2112ad7 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:55:02.401094 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=627d561d-d2ff-449e-a99f-9e5e3fd874ba,revision_number=9']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:02.417138 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 7c4354f0-0c69-4a70-b082-dcc2a2112ad7 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:02.417608 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.512739 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.534939 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port 7c4354f0-0c69-4a70-b082-dcc2a2112ad7, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=7c4354f0-0c69-4a70-b082-dcc2a2112ad7,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:02.539402 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.557784 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54486) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:02.563317 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1808110943-network', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:02.586901 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Made reservation on behalf of 8a427df7aae04fb486d16dc21e1096f1 for: {'network': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:55:02.589389 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.589795 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0bd6534b-40f7-44d8-a68e-3dfefa24ea93 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.599313 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.606218 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=7c4354f0-0c69-4a70-b082-dcc2a2112ad7,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:02.631286 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['627d561d-d2ff-449e-a99f-9e5e3fd874ba'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:55:02.692410 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.697894 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.718101 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] vlan segment allocate from pool success with {'vlan_id': 540, 'physical_network': 'physnet1'} {{(pid=109040) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:55:02.730084 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c2c62e2-ae6a-4ec5-bf93-774db4a624b6 req-01dc3afd-df8f-40fc-bca6-27fef1f2f3eb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:02.731797 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4c2c62e2-ae6a-4ec5-bf93-774db4a624b6 req-01dc3afd-df8f-40fc-bca6-27fef1f2f3eb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 945 time: 0.0493646 Nov 21 13:55:02.736647 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.737056 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.segments_db [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Added segment 78a76216-9ccc-495d-b652-9eac2e50acde of type vlan for network 08c5111b-0961-44c1-9cc0-edd7033d9b9c Nov 21 13:55:02.739287 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe1b9d65-1974-4425-b207-39e3303b52f2,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:02.785885 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.795847 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4c2c62e2-ae6a-4ec5-bf93-774db4a624b6 req-bf0b2b14-e674-4899-b678-16123ac9ecc2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0544918 Nov 21 13:55:02.814625 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.815610 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:02.816380 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:02.871285 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3123341 Nov 21 13:55:02.874235 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 54490) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:02.878237 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c552696b-f4ac-4b7b-ab80-55508f21d969 admin admin] Pushing event updated for resources: {'Network': ['ID=08c5111b-0961-44c1-9cc0-edd7033d9b9c,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:02.879526 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-cf7d7956-d4d7-411d-a699-edb001047b1d admin admin] Request body: {'subnet': {'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1808110943-subnet', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:02.888188 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 08c5111b-0961-44c1-9cc0-edd7033d9b9c details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:55:02.901642 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf7d7956-d4d7-411d-a699-edb001047b1d admin admin] Made reservation on behalf of 8a427df7aae04fb486d16dc21e1096f1 for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:55:02.904110 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cf7d7956-d4d7-411d-a699-edb001047b1d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-261005224'] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:03.087484 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cf7d7956-d4d7-411d-a699-edb001047b1d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3086915', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-261005206'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:03.139695 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf7d7956-d4d7-411d-a699-edb001047b1d admin admin] Pushing event updated for resources: {'Subnet': ['ID=878df1eb-5cc7-403d-97b2-590aeb393b7b,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:03.151750 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf7d7956-d4d7-411d-a699-edb001047b1d admin admin] Checking segment: {'id': '78a76216-9ccc-495d-b652-9eac2e50acde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 540, 'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:55:03.152151 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf7d7956-d4d7-411d-a699-edb001047b1d admin admin] Network hostable DHCP agents. Network: 08c5111b-0961-44c1-9cc0-edd7033d9b9c, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:55:03.170500 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf7d7956-d4d7-411d-a699-edb001047b1d admin admin] Network 08c5111b-0961-44c1-9cc0-edd7033d9b9c is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:55:03.179179 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-cf7d7956-d4d7-411d-a699-edb001047b1d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 08c5111b-0961-44c1-9cc0-edd7033d9b9c) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:55:03.183246 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf7d7956-d4d7-411d-a699-edb001047b1d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:03.183854 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cf7d7956-d4d7-411d-a699-edb001047b1d admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:03.189104 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e49ee96a-5977-407c-b834-a9e0409ea065 None None] Network 08c5111b-0961-44c1-9cc0-edd7033d9b9c requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:55:03.202170 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-cf7d7956-d4d7-411d-a699-edb001047b1d admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3260949 Nov 21 13:55:03.204151 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 54498) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:03.209862 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1808110943-router', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:03.231183 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-408660', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-58304'] for router, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:03.232275 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-473172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-468334', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1610115', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-58419'] for router, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:03.290294 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:03.349180 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6b3ed262-49ce-5e18-b10a-0ddd25bea067-08c5111b-0961-44c1-9cc0-edd7033d9b9c', 'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'fixed_ips': [{'subnet_id': '878df1eb-5cc7-403d-97b2-590aeb393b7b'}]}} from dv-cinder-768458-12-iscsi. {{(pid=109042) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 21 13:55:03.350034 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:03.438707 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:03.471461 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Sync routers for ids ['97eb221f-bbef-4cab-b393-a7606b8c7477'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:55:03.489116 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Routers {'97eb221f-bbef-4cab-b393-a7606b8c7477'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:55:03.489724 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:55:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['97eb221f-bbef-4cab-b393-a7606b8c7477'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:03.535321 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.db_base_plugin_common [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Allocated IP 172.20.0.2 (08c5111b-0961-44c1-9cc0-edd7033d9b9c/878df1eb-5cc7-403d-97b2-590aeb393b7b/05847e0e-f0cf-4e7d-ac5d-7e9300972822) {{(pid=109042) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:55:03.634912 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:03.658631 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:03.773500 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Allocated IP 172.27.1.87 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/d30bde6b-6556-4178-8b2a-516a2976ea2e) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:55:03.780124 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Set router 97eb221f-bbef-4cab-b393-a7606b8c7477 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:03.891953 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:03.924712 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c3004cf-178f-4e53-9796-dff342801eef req-755cf978-a71f-44c7-8f19-290b293d8ce6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:03.926745 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0c3004cf-178f-4e53-9796-dff342801eef req-755cf978-a71f-44c7-8f19-290b293d8ce6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 945 time: 0.0522659 Nov 21 13:55:03.934005 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:03.968616 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:03.979250 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:55:03.979495 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0c3004cf-178f-4e53-9796-dff342801eef req-6f2509d9-8ab9-4df9-95ee-c28759ee32e9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465395 Nov 21 13:55:03.983887 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:55:03.987591 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:55:03.988937 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Publish callbacks [] for port, precommit_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:04.010883 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Pushing event updated for resources: {'Port': ['ID=d30bde6b-6556-4178-8b2a-516a2976ea2e,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:04.015976 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:04.060761 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 627d561d-d2ff-449e-a99f-9e5e3fd874ba up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:55:04.105519 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Network 08c5111b-0961-44c1-9cc0-edd7033d9b9c is already hosted by enough agents. {{(pid=109042) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:55:04.131119 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.base_scheduler [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Resources bound (agent type, host, resource id): {{(pid=109042) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:55:04.133519 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Received port after_create {{(pid=109042) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:55:04.147443 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Pushing event updated for resources: {'Port': ['ID=05847e0e-f0cf-4e7d-ac5d-7e9300972822,revision_number=1']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:04.232374 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Attempting to bind port 05847e0e-f0cf-4e7d-ac5d-7e9300972822 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:55:04.232770 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Attempting to bind port 05847e0e-f0cf-4e7d-ac5d-7e9300972822 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '78a76216-9ccc-495d-b652-9eac2e50acde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 540, 'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:55:04.233144 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Attempting to bind port 05847e0e-f0cf-4e7d-ac5d-7e9300972822 on network 08c5111b-0961-44c1-9cc0-edd7033d9b9c {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:55:04.240233 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 627d561d-d2ff-449e-a99f-9e5e3fd874ba triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:04.240610 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:04.266312 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 54, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:55:04.266796 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Checking segment: {'id': '78a76216-9ccc-495d-b652-9eac2e50acde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 540, 'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:55:04.272170 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:04.272650 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Bound using segment: {'id': '78a76216-9ccc-495d-b652-9eac2e50acde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 540, 'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:55:04.273167 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Bound port: 05847e0e-f0cf-4e7d-ac5d-7e9300972822, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78a76216-9ccc-495d-b652-9eac2e50acde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 540, 'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:55:04.274776 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:04.278939 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:04.296889 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38'}], 'enable_snat': True}, 'gw_port_id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:01Z', 'revision_number': 4, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port': {'id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:b6:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'd03b886a-1564-44d9-a5a2-34ff7929ef4b', 'name': '', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'mac_address': 'fa:16:3e:23:78:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:00Z', 'updated_at': '2021-11-21T13:55:01Z', 'revision_number': 2, 'project_id': '406bef8592334a749f671da6881b0cf5', 'subnets': [{'id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:04.333572 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 7c4354f0-0c69-4a70-b082-dcc2a2112ad7 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:55:04.337732 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Checking router: 97eb221f-bbef-4cab-b393-a7606b8c7477 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:55:04.338060 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Updating router 97eb221f-bbef-4cab-b393-a7606b8c7477 port d03b886a-1564-44d9-a5a2-34ff7929ef4b binding host dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:55:04.362639 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d629de6f-e177-4228-bc06-a618862df06d req-c368945c-41bd-4dc8-ba41-acb7ef785e8c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:04.364344 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d629de6f-e177-4228-bc06-a618862df06d req-c368945c-41bd-4dc8-ba41-acb7ef785e8c tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0582063 Nov 21 13:55:04.413398 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d629de6f-e177-4228-bc06-a618862df06d req-3060f99f-2655-486c-b3a3-bb0c4025f578 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425968 Nov 21 13:55:04.427782 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:04.492982 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-473263', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-468275'] for router, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:04.525730 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] For port 05847e0e-f0cf-4e7d-ac5d-7e9300972822, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:55:04.543101 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:04.547030 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] For port 05847e0e-f0cf-4e7d-ac5d-7e9300972822, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=05847e0e-f0cf-4e7d-ac5d-7e9300972822,segment=NetworkSegment(78a76216-9ccc-495d-b652-9eac2e50acde),segment_id=78a76216-9ccc-495d-b652-9eac2e50acde)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:55:04.554343 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 7c4354f0-0c69-4a70-b082-dcc2a2112ad7 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:04.554704 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:04.599760 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:04.620145 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Router 705abd5c-0912-4311-842a-c2f3c483d3eb is scheduled to L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 with binding_index 1 {{(pid=109041) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 21 13:55:04.695915 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:55:04.698161 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-43102509-f9bf-4c8d-ba16-79e41ad18aab" -d '{"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-plugged", "status": "completed", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:55:04.729837 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:55:04.741848 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Sync routers for ids ['705abd5c-0912-4311-842a-c2f3c483d3eb'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:55:04.749826 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:04.751015 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] Publish callbacks [] for router, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:04.752520 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-5bd491a8-a9d5-426a-aafe-279ea8d26e35 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 1.5472298 Nov 21 13:55:04.756271 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54510) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:04.762500 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Routers {'705abd5c-0912-4311-842a-c2f3c483d3eb'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:55:04.766251 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:55:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['705abd5c-0912-4311-842a-c2f3c483d3eb'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:04.779356 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:55:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ceaddbf8-5f5c-49c2-b44e-94b6ddb0afc2 x-openstack-request-id: req-ceaddbf8-5f5c-49c2-b44e-94b6ddb0afc2 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:55:04.779719 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-plugged", "status": "completed", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:55:04.779946 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-ceaddbf8-5f5c-49c2-b44e-94b6ddb0afc2 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:55:04.780312 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'code': 200} Nov 21 13:55:04.784964 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cc39933-e5f8-4f18-a81c-cb78a9726ec9 None None] Pushing event updated for resources: {'Port': ['ID=05847e0e-f0cf-4e7d-ac5d-7e9300972822,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:04.788352 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:04.914224 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Set router 705abd5c-0912-4311-842a-c2f3c483d3eb gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:04.926059 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=627d561d-d2ff-449e-a99f-9e5e3fd874ba,revision_number=10']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:05.086229 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Publish callbacks [] for port, precommit_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.097008 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.098223 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.190638 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aec7b36f-35df-4a77-b31d-c0ca1405d5fc None None] Pushing event updated for resources: {'Port': ['ID=d03b886a-1564-44d9-a5a2-34ff7929ef4b,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:05.196186 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238cfa20-f685-4d4a-a588-4950e1406595 req-0f7559fa-942f-4cd8-ba05-d33585349a2f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:05.197860 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-238cfa20-f685-4d4a-a588-4950e1406595 req-0f7559fa-942f-4cd8-ba05-d33585349a2f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 947 time: 0.1054745 Nov 21 13:55:05.291206 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Attempting to bind port d03b886a-1564-44d9-a5a2-34ff7929ef4b on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:55:05.291587 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Attempting to bind port d03b886a-1564-44d9-a5a2-34ff7929ef4b by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:55:05.292286 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Attempting to bind port d03b886a-1564-44d9-a5a2-34ff7929ef4b on network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:55:05.297375 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 54, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:55:05.297752 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Checking segment: {'id': '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:55:05.298160 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.298741 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Bound using segment: {'id': '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:55:05.299077 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Bound port: d03b886a-1564-44d9-a5a2-34ff7929ef4b, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:55:05.299460 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.312025 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'name': 'tempest-TestMinimumBasicScenario-1808110943-router', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:55:04Z', 'revision_number': 3, 'project_id': '8a427df7aae04fb486d16dc21e1096f1', 'gw_port': {'id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:ba:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:55:03Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:05.354319 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Checking router: 705abd5c-0912-4311-842a-c2f3c483d3eb for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:55:05.354836 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Updating router 705abd5c-0912-4311-842a-c2f3c483d3eb port d30bde6b-6556-4178-8b2a-516a2976ea2e binding host dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:55:05.381441 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-238cfa20-f685-4d4a-a588-4950e1406595 req-a790ea6d-a098-4882-a7f2-b98ed5c6ef2e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1698189 Nov 21 13:55:05.387299 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51d39348-2387-4ee0-a7f7-de85165353d4 req-d3baf2b5-362b-4fcb-9d3f-6276dbf0246c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:05.388951 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-51d39348-2387-4ee0-a7f7-de85165353d4 req-d3baf2b5-362b-4fcb-9d3f-6276dbf0246c service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 1100 time: 0.0537636 Nov 21 13:55:05.394547 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.408913 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] For port d03b886a-1564-44d9-a5a2-34ff7929ef4b, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:55:05.425138 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] For port d03b886a-1564-44d9-a5a2-34ff7929ef4b, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=d03b886a-1564-44d9-a5a2-34ff7929ef4b,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:55:05.433493 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.465519 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-51d39348-2387-4ee0-a7f7-de85165353d4 req-fccbd002-7593-4f7c-b606-ded6ebd0a65d service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0621719 Nov 21 13:55:05.545668 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Routers {'97eb221f-bbef-4cab-b393-a7606b8c7477'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:55:05.546632 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:55:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['97eb221f-bbef-4cab-b393-a7606b8c7477'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:05.604217 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d2d31c7-ba18-4ddc-b5a9-a489c0160b88 req-f74c6437-4ea6-4782-8c84-98f8c50e09c1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:05.605761 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4d2d31c7-ba18-4ddc-b5a9-a489c0160b88 req-f74c6437-4ea6-4782-8c84-98f8c50e09c1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0717492 Nov 21 13:55:05.630257 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aec7b36f-35df-4a77-b31d-c0ca1405d5fc None None] Pushing event updated for resources: {'Port': ['ID=d03b886a-1564-44d9-a5a2-34ff7929ef4b,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:05.682613 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-4c61d845-ec3a-4390-b717-25e6278c4690 None None] Provisioning complete for port d03b886a-1564-44d9-a5a2-34ff7929ef4b triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:05.683004 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4c61d845-ec3a-4390-b717-25e6278c4690 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.702747 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4d2d31c7-ba18-4ddc-b5a9-a489c0160b88 req-c4b11530-9285-4d5a-bebc-21822399bf75 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0842459 Nov 21 13:55:05.712674 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.752713 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] Set router 97eb221f-bbef-4cab-b393-a7606b8c7477 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:05.765163 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Publish callbacks [] for port, precommit_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.777610 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.825805 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9486849c-d466-4c47-82fb-3388d9e44dcd None None] Pushing event updated for resources: {'Port': ['ID=d30bde6b-6556-4178-8b2a-516a2976ea2e,revision_number=2']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:05.858409 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Attempting to bind port d30bde6b-6556-4178-8b2a-516a2976ea2e on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:55:05.859067 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Attempting to bind port d30bde6b-6556-4178-8b2a-516a2976ea2e by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:55:05.859753 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Attempting to bind port d30bde6b-6556-4178-8b2a-516a2976ea2e on network 67069811-a3d5-4953-8a57-e62d44750fe3 {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:55:05.865694 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 54, 36), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:55:05.867243 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Checking segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109043) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:55:05.867885 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.868474 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Bound using segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:55:05.869839 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Bound port: d30bde6b-6556-4178-8b2a-516a2976ea2e, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:55:05.870480 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.923240 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.929420 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Allocated IP 172.20.0.1 (08c5111b-0961-44c1-9cc0-edd7033d9b9c/878df1eb-5cc7-403d-97b2-590aeb393b7b/e6e9b263-663a-4c89-936d-c14636fe4f02) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:55:05.929623 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4c61d845-ec3a-4390-b717-25e6278c4690 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:05.936123 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] For port d30bde6b-6556-4178-8b2a-516a2976ea2e, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109043) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:55:05.941089 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] For port d30bde6b-6556-4178-8b2a-516a2976ea2e, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=d30bde6b-6556-4178-8b2a-516a2976ea2e,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109043) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:55:05.947020 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.003218 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-4c61d845-ec3a-4390-b717-25e6278c4690 None None] For port d03b886a-1564-44d9-a5a2-34ff7929ef4b, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=d03b886a-1564-44d9-a5a2-34ff7929ef4b,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:06.007659 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9486849c-d466-4c47-82fb-3388d9e44dcd None None] Pushing event updated for resources: {'Port': ['ID=d30bde6b-6556-4178-8b2a-516a2976ea2e,revision_number=3']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:06.031546 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4c61d845-ec3a-4390-b717-25e6278c4690 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.031834 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Routers {'705abd5c-0912-4311-842a-c2f3c483d3eb'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:55:06.032273 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:55:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['705abd5c-0912-4311-842a-c2f3c483d3eb'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:06.063227 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.109290 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.163550 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] Set router 705abd5c-0912-4311-842a-c2f3c483d3eb gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:06.166216 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Network 08c5111b-0961-44c1-9cc0-edd7033d9b9c is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:55:06.169170 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:55:06.173094 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:55:06.173570 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-470894'] for router_interface, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.205384 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04d9bd41-1b59-41c7-ab10-d63647a9a0ed None None] Network 08c5111b-0961-44c1-9cc0-edd7033d9b9c requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:55:06.295205 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Pushing event updated for resources: {'Port': ['ID=e6e9b263-663a-4c89-936d-c14636fe4f02,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:06.310829 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c61d845-ec3a-4390-b717-25e6278c4690 None None] Pushing event updated for resources: {'Port': ['ID=d03b886a-1564-44d9-a5a2-34ff7929ef4b,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:06.316046 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-b3fe71c5-8756-4a13-b6e6-be57753b7c46 None None] Provisioning complete for port d03b886a-1564-44d9-a5a2-34ff7929ef4b triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:06.316872 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-b3fe71c5-8756-4a13-b6e6-be57753b7c46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.353043 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.356226 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 05847e0e-f0cf-4e7d-ac5d-7e9300972822 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:55:06.414585 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'name': 'tempest-TestMinimumBasicScenario-1808110943-router', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:55:04Z', 'revision_number': 3, 'project_id': '8a427df7aae04fb486d16dc21e1096f1', 'gw_port': {'id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:ba:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:55:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:06.444990 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a61b0663-fe35-4f63-b5ca-4cbbe62d9fc5 None None] The sync data for ids ['705abd5c-0912-4311-842a-c2f3c483d3eb'] in dv-cinder-768458-12-iscsi is: [{'id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'name': 'tempest-TestMinimumBasicScenario-1808110943-router', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:55:04Z', 'revision_number': 3, 'project_id': '8a427df7aae04fb486d16dc21e1096f1', 'gw_port': {'id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:ba:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:55:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:55:06.476747 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38'}], 'enable_snat': True}, 'gw_port_id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:01Z', 'revision_number': 4, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port': {'id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:b6:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'd03b886a-1564-44d9-a5a2-34ff7929ef4b', 'name': '', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'mac_address': 'fa:16:3e:23:78:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:00Z', 'updated_at': '2021-11-21T13:55:05Z', 'revision_number': 4, 'project_id': '406bef8592334a749f671da6881b0cf5', 'subnets': [{'id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:06.529530 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8197bad2-177d-494c-9b21-52283e1b4de9 None None] The sync data for ids ['97eb221f-bbef-4cab-b393-a7606b8c7477'] in dv-cinder-768458-12-iscsi is: [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38'}], 'enable_snat': True}, 'gw_port_id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:01Z', 'revision_number': 4, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port': {'id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:b6:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'd03b886a-1564-44d9-a5a2-34ff7929ef4b', 'name': '', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'mac_address': 'fa:16:3e:23:78:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:00Z', 'updated_at': '2021-11-21T13:55:05Z', 'revision_number': 4, 'project_id': '406bef8592334a749f671da6881b0cf5', 'subnets': [{'id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:55:06.575317 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 05847e0e-f0cf-4e7d-ac5d-7e9300972822 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:06.575689 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.600799 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508c01f0-e94c-4bc3-af52-23e8a2bd4862 req-9e3f9bec-3270-404e-8d72-fa8348ea08ac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:06.600799 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-508c01f0-e94c-4bc3-af52-23e8a2bd4862 req-9e3f9bec-3270-404e-8d72-fa8348ea08ac tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 947 time: 0.1001503 Nov 21 13:55:06.603033 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.609328 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.610388 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1684480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-473342'] for router_interface, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.693193 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.821368 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Pushing event updated for resources: {'Port': ['ID=e6e9b263-663a-4c89-936d-c14636fe4f02,revision_number=2']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:06.850552 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port 05847e0e-f0cf-4e7d-ac5d-7e9300972822, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=05847e0e-f0cf-4e7d-ac5d-7e9300972822,segment=NetworkSegment(78a76216-9ccc-495d-b652-9eac2e50acde),segment_id=78a76216-9ccc-495d-b652-9eac2e50acde)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:06.880146 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-508c01f0-e94c-4bc3-af52-23e8a2bd4862 req-130d05b9-86b3-4df7-bb16-e8eea4107c91 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2416608 Nov 21 13:55:06.882486 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.894045 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-45b79936-6215-4bfe-84c5-e3f43641fefe None None] Provisioning complete for port 05847e0e-f0cf-4e7d-ac5d-7e9300972822 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:06.894683 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-45b79936-6215-4bfe-84c5-e3f43641fefe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:06.982636 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d500fad6-a6de-4f4b-a637-c150b568106d req-839eea8b-1356-4b74-bea9-ad06e23a22da tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:06.984016 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Network 08c5111b-0961-44c1-9cc0-edd7033d9b9c is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:55:06.985702 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d500fad6-a6de-4f4b-a637-c150b568106d req-839eea8b-1356-4b74-bea9-ad06e23a22da tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.1665649 Nov 21 13:55:06.989344 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:55:07.043215 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=05847e0e-f0cf-4e7d-ac5d-7e9300972822,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:07.128346 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d500fad6-a6de-4f4b-a637-c150b568106d req-96e2c7f5-84ee-4b6b-b8ff-6e5172723d86 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1342103 Nov 21 13:55:07.265538 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Router 705abd5c-0912-4311-842a-c2f3c483d3eb has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:55:07.350246 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a req-44a41ca8-15df-4bb4-a154-753f692eb3e2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:07.356003 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a req-44a41ca8-15df-4bb4-a154-753f692eb3e2 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.50 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 945 time: 0.0992849 Nov 21 13:55:07.364702 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-b8126e10-026f-4a88-9fe8-f1695e39873f None None] Provisioning complete for port e6e9b263-663a-4c89-936d-c14636fe4f02 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:07.365097 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-b8126e10-026f-4a88-9fe8-f1695e39873f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:07.479686 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-b8126e10-026f-4a88-9fe8-f1695e39873f None None] Port e6e9b263-663a-4c89-936d-c14636fe4f02 cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:55:07.514269 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-b8126e10-026f-4a88-9fe8-f1695e39873f None None] Provisioning complete for port 05847e0e-f0cf-4e7d-ac5d-7e9300972822 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:07.514641 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-b8126e10-026f-4a88-9fe8-f1695e39873f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:07.554581 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a req-0ae54549-9f8f-46d9-8dee-e84f2db3e669 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Deleting port dcf844c6-0002-4d63-9e63-4bf56191c807 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:55:07.555102 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a req-0ae54549-9f8f-46d9-8dee-e84f2db3e669 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:07.626755 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:55:07.644450 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-1636d6b8-195f-457a-828f-9e518173edaa admin admin] 10.222.0.11 "PUT /v2.0/routers/705abd5c-0912-4311-842a-c2f3c483d3eb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8823867 Nov 21 13:55:07.769395 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a req-0ae54549-9f8f-46d9-8dee-e84f2db3e669 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] For port dcf844c6-0002-4d63-9e63-4bf56191c807, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=dcf844c6-0002-4d63-9e63-4bf56191c807,segment=NetworkSegment(87188554-865b-4f60-ac47-7f9dc768573f),segment_id=87188554-865b-4f60-ac47-7f9dc768573f)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:07.770020 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a req-0ae54549-9f8f-46d9-8dee-e84f2db3e669 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:07.815996 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a req-0ae54549-9f8f-46d9-8dee-e84f2db3e669 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling delete_port for dcf844c6-0002-4d63-9e63-4bf56191c807 owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:55:07.915435 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-6146bf53-7bc5-4941-a5d0-ba3a665f5856 None None] Provisioning complete for port e6e9b263-663a-4c89-936d-c14636fe4f02 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:07.916270 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6146bf53-7bc5-4941-a5d0-ba3a665f5856 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:08.043354 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-6146bf53-7bc5-4941-a5d0-ba3a665f5856 None None] Port e6e9b263-663a-4c89-936d-c14636fe4f02 cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:55:08.128169 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcd4c885-9c44-49de-a1d6-39ade35cb65c req-1f1ed6fb-bc18-4beb-a259-d401672c299c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:08.131251 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fcd4c885-9c44-49de-a1d6-39ade35cb65c req-1f1ed6fb-bc18-4beb-a259-d401672c299c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 947 time: 0.0928979 Nov 21 13:55:08.132618 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a req-0ae54549-9f8f-46d9-8dee-e84f2db3e669 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:08.156898 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5', 'dcf844c6-0002-4d63-9e63-4bf56191c807'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:55:08.202388 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ae54549-9f8f-46d9-8dee-e84f2db3e669 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Pushing event deleted for resources: {'Port': ['ID=dcf844c6-0002-4d63-9e63-4bf56191c807,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:08.309272 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-6486144f-0b5f-431f-a188-72f55943c655 req-5fb504cf-d185-4c5a-8705-8f3c612f56a8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=e6f04799-b287-41b6-9756-b259d5eeddeb HTTP/1.1" status: 200 len: 210 time: 0.0451448 Nov 21 13:55:08.366671 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a req-0ae54549-9f8f-46d9-8dee-e84f2db3e669 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] No DVR routers for this DVR port dcf844c6-0002-4d63-9e63-4bf56191c807 on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:55:08.388623 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a req-0ae54549-9f8f-46d9-8dee-e84f2db3e669 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:08.398119 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2b03bfaf-89cb-4f5e-96e6-6e98568fcf3a req-0ae54549-9f8f-46d9-8dee-e84f2db3e669 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.50 "DELETE /v2.0/ports/dcf844c6-0002-4d63-9e63-4bf56191c807 HTTP/1.1" status: 204 len: 173 time: 1.0336001 Nov 21 13:55:08.398634 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e6f04799-b287-41b6-9756-b259d5eeddeb', 'name': 'network-vif-deleted', 'tag': 'dcf844c6-0002-4d63-9e63-4bf56191c807'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:55:08.401033 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c450ace-8808-4210-86ed-2eb66c15ef2d" -d '{"events": [{"server_uuid": "e6f04799-b287-41b6-9756-b259d5eeddeb", "name": "network-vif-deleted", "tag": "dcf844c6-0002-4d63-9e63-4bf56191c807"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:55:08.437692 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fcd4c885-9c44-49de-a1d6-39ade35cb65c req-50d65394-1d26-498e-ad6b-50c2bdc7d16b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2854786 Nov 21 13:55:08.477313 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:55:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c869dbc-533b-47da-a254-296f5b6adf34 x-openstack-request-id: req-5c869dbc-533b-47da-a254-296f5b6adf34 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:55:08.477610 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e6f04799-b287-41b6-9756-b259d5eeddeb", "name": "network-vif-deleted", "tag": "dcf844c6-0002-4d63-9e63-4bf56191c807", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:55:08.477913 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-5c869dbc-533b-47da-a254-296f5b6adf34 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:55:08.478396 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e6f04799-b287-41b6-9756-b259d5eeddeb', 'name': 'network-vif-deleted', 'tag': 'dcf844c6-0002-4d63-9e63-4bf56191c807', 'status': 'completed', 'code': 200} Nov 21 13:55:08.594687 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device d30bde6b-6556-4178-8b2a-516a2976ea2e up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:55:08.663726 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port d30bde6b-6556-4178-8b2a-516a2976ea2e triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:08.664114 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:08.758409 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:08.786550 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port d30bde6b-6556-4178-8b2a-516a2976ea2e, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=d30bde6b-6556-4178-8b2a-516a2976ea2e,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:08.794777 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:08.795584 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 05847e0e-f0cf-4e7d-ac5d-7e9300972822 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:55:08.887755 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=d30bde6b-6556-4178-8b2a-516a2976ea2e,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:08.904630 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 05847e0e-f0cf-4e7d-ac5d-7e9300972822 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:08.905258 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:09.070801 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device d03b886a-1564-44d9-a5a2-34ff7929ef4b up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:55:09.127280 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port d03b886a-1564-44d9-a5a2-34ff7929ef4b triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:09.127280 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:09.695512 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b13c934-4b10-456c-8dbb-c4baacc20461 req-09871d2d-56a8-4d5a-a7cc-5c51f9669576 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:09.697794 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7b13c934-4b10-456c-8dbb-c4baacc20461 req-09871d2d-56a8-4d5a-a7cc-5c51f9669576 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0719407 Nov 21 13:55:09.701631 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcf10e63-a47a-4701-be8a-b1127f2a584c req-b6675742-f846-4a1b-9905-f7c48cbd6175 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:09.712560 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bcf10e63-a47a-4701-be8a-b1127f2a584c req-b6675742-f846-4a1b-9905-f7c48cbd6175 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 947 time: 0.0912313 Nov 21 13:55:09.775790 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Sync routers for ids ['705abd5c-0912-4311-842a-c2f3c483d3eb'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:55:09.786945 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7b13c934-4b10-456c-8dbb-c4baacc20461 req-fea83daf-5bec-493b-95c4-dca8d7473e5d tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750446 Nov 21 13:55:09.795007 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Routers {'705abd5c-0912-4311-842a-c2f3c483d3eb'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:55:09.796077 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:55:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['705abd5c-0912-4311-842a-c2f3c483d3eb'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:09.804491 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bcf10e63-a47a-4701-be8a-b1127f2a584c req-1b277a96-3236-4942-9bb0-d74f9f381a29 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0853388 Nov 21 13:55:09.927037 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-611313aa-071a-4078-8a85-1cb2c90b33f7 req-b9e16675-2878-4b66-af93-6f6981e9b156 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:09.928992 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-611313aa-071a-4078-8a85-1cb2c90b33f7 req-b9e16675-2878-4b66-af93-6f6981e9b156 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0515778 Nov 21 13:55:09.949769 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Set router 705abd5c-0912-4311-842a-c2f3c483d3eb gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:09.979528 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-611313aa-071a-4078-8a85-1cb2c90b33f7 req-8cbee098-041e-49ce-97fd-bd56477232b0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438318 Nov 21 13:55:10.302941 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device d30bde6b-6556-4178-8b2a-516a2976ea2e up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:55:10.356394 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'name': 'tempest-TestMinimumBasicScenario-1808110943-router', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:55:06Z', 'revision_number': 4, 'project_id': '8a427df7aae04fb486d16dc21e1096f1', 'gw_port': {'id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:ba:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:55:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'e6e9b263-663a-4c89-936d-c14636fe4f02', 'name': '', 'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'mac_address': 'fa:16:3e:b1:47:92', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'device_owner': 'network:router_interface', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': '878df1eb-5cc7-403d-97b2-590aeb393b7b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:05Z', 'updated_at': '2021-11-21T13:55:06Z', 'revision_number': 2, 'project_id': '8a427df7aae04fb486d16dc21e1096f1', 'subnets': [{'id': '878df1eb-5cc7-403d-97b2-590aeb393b7b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:10.391692 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Checking router: 705abd5c-0912-4311-842a-c2f3c483d3eb for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:55:10.392079 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Updating router 705abd5c-0912-4311-842a-c2f3c483d3eb port e6e9b263-663a-4c89-936d-c14636fe4f02 binding host dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 13:55:10.414822 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port d30bde6b-6556-4178-8b2a-516a2976ea2e triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:10.415191 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:10.439793 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:10.775296 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Publish callbacks [] for port, precommit_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:10.782552 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:10.885023 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11cbfb8a-e62c-4ea8-bc48-8034892e12a8 None None] Pushing event updated for resources: {'Port': ['ID=e6e9b263-663a-4c89-936d-c14636fe4f02,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:10.918938 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Attempting to bind port e6e9b263-663a-4c89-936d-c14636fe4f02 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:55:10.920890 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Attempting to bind port e6e9b263-663a-4c89-936d-c14636fe4f02 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '78a76216-9ccc-495d-b652-9eac2e50acde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 540, 'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:55:10.921276 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Attempting to bind port e6e9b263-663a-4c89-936d-c14636fe4f02 on network 08c5111b-0961-44c1-9cc0-edd7033d9b9c {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:55:10.933583 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 55, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:55:10.933975 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Checking segment: {'id': '78a76216-9ccc-495d-b652-9eac2e50acde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 540, 'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:55:10.934385 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:10.934788 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Bound using segment: {'id': '78a76216-9ccc-495d-b652-9eac2e50acde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 540, 'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:55:10.936325 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Bound port: e6e9b263-663a-4c89-936d-c14636fe4f02, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78a76216-9ccc-495d-b652-9eac2e50acde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 540, 'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:55:10.936750 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:10.945836 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784af963-5866-4f89-9758-3d0ebdb68138 req-ef9c2714-adf9-4a7e-8cac-bcef27208bdd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:10.950452 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-784af963-5866-4f89-9758-3d0ebdb68138 req-ef9c2714-adf9-4a7e-8cac-bcef27208bdd tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0717432 Nov 21 13:55:11.021661 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-784af963-5866-4f89-9758-3d0ebdb68138 req-5738f5b3-d033-424f-a638-58178f7d7555 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647123 Nov 21 13:55:11.046515 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] For port e6e9b263-663a-4c89-936d-c14636fe4f02, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:55:11.050977 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] For port e6e9b263-663a-4c89-936d-c14636fe4f02, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=e6e9b263-663a-4c89-936d-c14636fe4f02,segment=NetworkSegment(78a76216-9ccc-495d-b652-9eac2e50acde),segment_id=78a76216-9ccc-495d-b652-9eac2e50acde)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:55:11.057504 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:11.142925 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad48c1ed-1e76-4d1d-8ef1-838e07722d99 req-6ad074ca-86af-4cef-a23e-ccc13b6951ab tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:11.148306 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ad48c1ed-1e76-4d1d-8ef1-838e07722d99 req-6ad074ca-86af-4cef-a23e-ccc13b6951ab tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0700254 Nov 21 13:55:11.152923 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Routers {'705abd5c-0912-4311-842a-c2f3c483d3eb'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:55:11.153536 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:55:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['705abd5c-0912-4311-842a-c2f3c483d3eb'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:11.239695 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ad48c1ed-1e76-4d1d-8ef1-838e07722d99 req-3422313a-adca-4227-acc0-9ceafacb1303 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0888276 Nov 21 13:55:11.281692 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11cbfb8a-e62c-4ea8-bc48-8034892e12a8 None None] Pushing event updated for resources: {'Port': ['ID=e6e9b263-663a-4c89-936d-c14636fe4f02,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:11.300173 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-e075276a-16ac-4272-b6a9-6e6d6f38301b None None] Provisioning complete for port e6e9b263-663a-4c89-936d-c14636fe4f02 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:11.300654 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e075276a-16ac-4272-b6a9-6e6d6f38301b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:11.336474 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] Set router 705abd5c-0912-4311-842a-c2f3c483d3eb gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:11.521838 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e075276a-16ac-4272-b6a9-6e6d6f38301b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:11.586381 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-e075276a-16ac-4272-b6a9-6e6d6f38301b None None] For port e6e9b263-663a-4c89-936d-c14636fe4f02, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=e6e9b263-663a-4c89-936d-c14636fe4f02,segment=NetworkSegment(78a76216-9ccc-495d-b652-9eac2e50acde),segment_id=78a76216-9ccc-495d-b652-9eac2e50acde)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:11.594575 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e075276a-16ac-4272-b6a9-6e6d6f38301b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:11.655422 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'name': 'tempest-TestMinimumBasicScenario-1808110943-router', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:55:06Z', 'revision_number': 4, 'project_id': '8a427df7aae04fb486d16dc21e1096f1', 'gw_port': {'id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:ba:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:55:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'e6e9b263-663a-4c89-936d-c14636fe4f02', 'name': '', 'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'mac_address': 'fa:16:3e:b1:47:92', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'device_owner': 'network:router_interface', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': '878df1eb-5cc7-403d-97b2-590aeb393b7b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:05Z', 'updated_at': '2021-11-21T13:55:11Z', 'revision_number': 4, 'project_id': '8a427df7aae04fb486d16dc21e1096f1', 'subnets': [{'id': '878df1eb-5cc7-403d-97b2-590aeb393b7b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:11.659040 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e075276a-16ac-4272-b6a9-6e6d6f38301b None None] Pushing event updated for resources: {'Port': ['ID=e6e9b263-663a-4c89-936d-c14636fe4f02,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:11.688321 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68f592b-75eb-4685-97f3-643604a6a941 None None] The sync data for ids ['705abd5c-0912-4311-842a-c2f3c483d3eb'] in dv-cinder-768458-12-iscsi is: [{'id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'name': 'tempest-TestMinimumBasicScenario-1808110943-router', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:55:06Z', 'revision_number': 4, 'project_id': '8a427df7aae04fb486d16dc21e1096f1', 'gw_port': {'id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:ba:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:55:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'e6e9b263-663a-4c89-936d-c14636fe4f02', 'name': '', 'network_id': '08c5111b-0961-44c1-9cc0-edd7033d9b9c', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'mac_address': 'fa:16:3e:b1:47:92', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'device_owner': 'network:router_interface', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': '878df1eb-5cc7-403d-97b2-590aeb393b7b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:05Z', 'updated_at': '2021-11-21T13:55:11Z', 'revision_number': 4, 'project_id': '8a427df7aae04fb486d16dc21e1096f1', 'subnets': [{'id': '878df1eb-5cc7-403d-97b2-590aeb393b7b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:55:11.720309 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-4dd62ed9-0943-4e7e-b2e6-65d0b6318737 None None] Provisioning complete for port e6e9b263-663a-4c89-936d-c14636fe4f02 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:11.720641 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4dd62ed9-0943-4e7e-b2e6-65d0b6318737 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:12.092427 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device dcf844c6-0002-4d63-9e63-4bf56191c807 no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:55:12.138985 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: dcf844c6-0002-4d63-9e63-4bf56191c807 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:55:12.149239 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device dcf844c6-0002-4d63-9e63-4bf56191c807 not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:55:12.159440 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf2e70dc-5811-499e-8681-1ad12abbe68c req-1e1e1e0f-cd98-43c6-bc68-29843ef1e9bc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:12.162417 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-bf2e70dc-5811-499e-8681-1ad12abbe68c req-1e1e1e0f-cd98-43c6-bc68-29843ef1e9bc tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0571647 Nov 21 13:55:12.223498 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-bf2e70dc-5811-499e-8681-1ad12abbe68c req-8bc5f672-2dc4-4848-b8b0-4efe1606fd83 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529144 Nov 21 13:55:12.371414 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0fdc896-a401-447d-bc4f-a3b88037b5f2 req-4d805a93-fcaa-4057-a6c9-6e5126e6b31d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:12.383112 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e0fdc896-a401-447d-bc4f-a3b88037b5f2 req-4d805a93-fcaa-4057-a6c9-6e5126e6b31d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0752661 Nov 21 13:55:12.395625 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device e6e9b263-663a-4c89-936d-c14636fe4f02 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:55:12.443552 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e0fdc896-a401-447d-bc4f-a3b88037b5f2 req-d4b18df4-526d-4263-a021-91db59e72df2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0594463 Nov 21 13:55:12.471768 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port e6e9b263-663a-4c89-936d-c14636fe4f02 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:12.472552 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:13.340544 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-632ee505-a9a6-4b2e-a57d-642cb6a477fe req-69b7a68e-a7ac-40ca-89e0-a09f195c2a78 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:13.342060 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-632ee505-a9a6-4b2e-a57d-642cb6a477fe req-69b7a68e-a7ac-40ca-89e0-a09f195c2a78 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0562382 Nov 21 13:55:13.406799 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-632ee505-a9a6-4b2e-a57d-642cb6a477fe req-6577679e-5213-4cfa-849a-46567f10ee96 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582557 Nov 21 13:55:13.568682 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b148de3-8f6c-443d-9da2-77e5d28ce619 req-d8fc6170-00c3-4562-a156-8b4b209f4b55 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:13.570767 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4b148de3-8f6c-443d-9da2-77e5d28ce619 req-d8fc6170-00c3-4562-a156-8b4b209f4b55 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0510144 Nov 21 13:55:13.628528 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4b148de3-8f6c-443d-9da2-77e5d28ce619 req-16dbd0c2-0566-423d-8d43-8fc34763da8f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0504768 Nov 21 13:55:14.552783 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efabaaca-ab54-4a9b-bf1e-9f65902e3cb9 req-c99726ed-49dc-4ba7-9c0b-0ad6ae90ddd4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:14.554296 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-efabaaca-ab54-4a9b-bf1e-9f65902e3cb9 req-c99726ed-49dc-4ba7-9c0b-0ad6ae90ddd4 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0576630 Nov 21 13:55:14.617975 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-efabaaca-ab54-4a9b-bf1e-9f65902e3cb9 req-299730f5-b24b-45fe-85aa-1bb32abfeed5 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576687 Nov 21 13:55:14.746052 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89e41f6f-8323-4835-bd14-2d3b393eb975 req-99aed06f-7cb9-4811-b56d-525ca8195b76 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:14.747529 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-89e41f6f-8323-4835-bd14-2d3b393eb975 req-99aed06f-7cb9-4811-b56d-525ca8195b76 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0543282 Nov 21 13:55:14.799793 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-89e41f6f-8323-4835-bd14-2d3b393eb975 req-62abdc9f-78bf-4124-ac07-953231f8a774 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450563 Nov 21 13:55:15.618698 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e289a7-a230-423a-b7e2-4e9f663ada4b req-e983afe8-99b8-47a9-8673-12553dc810ed tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:15.620234 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-04e289a7-a230-423a-b7e2-4e9f663ada4b req-e983afe8-99b8-47a9-8673-12553dc810ed tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.50 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0506365 Nov 21 13:55:15.730398 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-04e289a7-a230-423a-b7e2-4e9f663ada4b req-54a40a0a-cb64-4edd-bddf-4688a0c560f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Deleting port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:55:15.730752 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-04e289a7-a230-423a-b7e2-4e9f663ada4b req-54a40a0a-cb64-4edd-bddf-4688a0c560f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:15.768606 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2de15cfa-c93e-4301-9bcf-ff11cd2e4a6d req-70bb2921-4c3e-411a-83b8-f3a3c47fefc1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:15.770802 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2de15cfa-c93e-4301-9bcf-ff11cd2e4a6d req-70bb2921-4c3e-411a-83b8-f3a3c47fefc1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/ports?device_id=2d1c9d3d-f088-4d2f-b2bc-e26543509aae HTTP/1.1" status: 200 len: 945 time: 0.0657816 Nov 21 13:55:15.829755 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2de15cfa-c93e-4301-9bcf-ff11cd2e4a6d req-f71b0940-40fa-46b0-9010-9266fc244ad1 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.11 "GET /v2.0/security-groups?id=a8d8f563-6329-49d2-be60-2c66fef726e1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523727 Nov 21 13:55:15.867748 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-04e289a7-a230-423a-b7e2-4e9f663ada4b req-54a40a0a-cb64-4edd-bddf-4688a0c560f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] For port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5,segment=NetworkSegment(87188554-865b-4f60-ac47-7f9dc768573f),segment_id=87188554-865b-4f60-ac47-7f9dc768573f)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:15.867748 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-04e289a7-a230-423a-b7e2-4e9f663ada4b req-54a40a0a-cb64-4edd-bddf-4688a0c560f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:15.882019 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-04e289a7-a230-423a-b7e2-4e9f663ada4b req-54a40a0a-cb64-4edd-bddf-4688a0c560f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Calling delete_port for e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:55:15.974056 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c586bcd-7c14-4c84-aa0a-98ebfcdd762f req-b5e5c3d7-2ef0-4807-ac17-ff2cb2cff399 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:15.975521 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0c586bcd-7c14-4c84-aa0a-98ebfcdd762f req-b5e5c3d7-2ef0-4807-ac17-ff2cb2cff399 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0915203 Nov 21 13:55:16.043091 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0c586bcd-7c14-4c84-aa0a-98ebfcdd762f req-33d9e7d2-9b2c-47dd-9509-58e1ee9efcbd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0583034 Nov 21 13:55:16.122225 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-04e289a7-a230-423a-b7e2-4e9f663ada4b req-54a40a0a-cb64-4edd-bddf-4688a0c560f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:16.135083 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:55:16.155961 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a40a0a-cb64-4edd-bddf-4688a0c560f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Pushing event deleted for resources: {'Port': ['ID=e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:16.214861 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-04e289a7-a230-423a-b7e2-4e9f663ada4b req-54a40a0a-cb64-4edd-bddf-4688a0c560f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] No DVR routers for this DVR port e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:55:16.217551 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-04e289a7-a230-423a-b7e2-4e9f663ada4b req-54a40a0a-cb64-4edd-bddf-4688a0c560f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:16.220985 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-04e289a7-a230-423a-b7e2-4e9f663ada4b req-54a40a0a-cb64-4edd-bddf-4688a0c560f8 tempest-ServerRescueNegativeTestJSON-665943359 tempest-ServerRescueNegativeTestJSON-665943359-project] 10.222.0.50 "DELETE /v2.0/ports/e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 HTTP/1.1" status: 204 len: 173 time: 0.5929863 Nov 21 13:55:16.221576 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2d1c9d3d-f088-4d2f-b2bc-e26543509aae', 'name': 'network-vif-deleted', 'tag': 'e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:55:16.224182 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f3ebd8ba-e8d8-43ec-92c0-4182623d989a" -d '{"events": [{"server_uuid": "2d1c9d3d-f088-4d2f-b2bc-e26543509aae", "name": "network-vif-deleted", "tag": "e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:55:16.273610 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:55:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a90622ff-57da-47c6-bb84-f6b5cf85f1d1 x-openstack-request-id: req-a90622ff-57da-47c6-bb84-f6b5cf85f1d1 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:55:16.274016 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2d1c9d3d-f088-4d2f-b2bc-e26543509aae", "name": "network-vif-deleted", "tag": "e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:55:16.274512 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-a90622ff-57da-47c6-bb84-f6b5cf85f1d1 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:55:16.275017 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2d1c9d3d-f088-4d2f-b2bc-e26543509aae', 'name': 'network-vif-deleted', 'tag': 'e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5', 'status': 'completed', 'code': 200} Nov 21 13:55:16.894232 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54648) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:17.256427 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860319c1-243b-42e0-8bce-c17ca744ea31 req-97848870-8e4b-4011-ba81-924a3b6f01af tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:17.258043 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-860319c1-243b-42e0-8bce-c17ca744ea31 req-97848870-8e4b-4011-ba81-924a3b6f01af tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.1168659 Nov 21 13:55:17.338067 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-860319c1-243b-42e0-8bce-c17ca744ea31 req-27f88fad-3ac6-4668-a56c-4e2d5b58d869 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0736492 Nov 21 13:55:17.443661 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d8145dbc-ae9b-4626-a49f-c45e1ef08e51 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-473237'] for router_interface, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:17.960220 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-d8145dbc-ae9b-4626-a49f-c45e1ef08e51 admin admin] Deleting port 50c44d25-bd25-498f-8438-1dc33e1348ec {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:55:17.960828 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d8145dbc-ae9b-4626-a49f-c45e1ef08e51 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:18.041741 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-d8145dbc-ae9b-4626-a49f-c45e1ef08e51 admin admin] For port 50c44d25-bd25-498f-8438-1dc33e1348ec, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=50c44d25-bd25-498f-8438-1dc33e1348ec,segment=NetworkSegment(87188554-865b-4f60-ac47-7f9dc768573f),segment_id=87188554-865b-4f60-ac47-7f9dc768573f)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:18.042122 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d8145dbc-ae9b-4626-a49f-c45e1ef08e51 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:18.054336 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-d8145dbc-ae9b-4626-a49f-c45e1ef08e51 admin admin] Calling delete_port for 50c44d25-bd25-498f-8438-1dc33e1348ec owned by network:router_interface {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:55:18.280630 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d8145dbc-ae9b-4626-a49f-c45e1ef08e51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:18.320447 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8145dbc-ae9b-4626-a49f-c45e1ef08e51 admin admin] Pushing event deleted for resources: {'Port': ['ID=50c44d25-bd25-498f-8438-1dc33e1348ec,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:18.458064 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c1cf9d1-ad13-4152-b232-be756132dcf7 req-af39cd6b-32cc-4910-8f38-f7f69970c590 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:18.459533 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7c1cf9d1-ad13-4152-b232-be756132dcf7 req-af39cd6b-32cc-4910-8f38-f7f69970c590 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0486286 Nov 21 13:55:18.493646 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-8054f65f-ec2f-48dc-95d5-b20e1365a5ca tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:18.495086 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-8054f65f-ec2f-48dc-95d5-b20e1365a5ca tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/networks?id=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 HTTP/1.1" status: 200 len: 814 time: 0.2062585 Nov 21 13:55:18.506041 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7c1cf9d1-ad13-4152-b232-be756132dcf7 req-2ca081d5-95b9-4541-879c-4459a7c78016 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403941 Nov 21 13:55:18.514987 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-c5cb88a1-1b37-47ae-b256-e02cbd62b86d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/quotas/406bef8592334a749f671da6881b0cf5 HTTP/1.1" status: 200 len: 375 time: 0.0131021 Nov 21 13:55:18.515547 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d8145dbc-ae9b-4626-a49f-c45e1ef08e51 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1684491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-473209'] for router_interface, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:18.639705 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-fdcee689-49b2-41c7-ab0b-4d1395ad2fd6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=406bef8592334a749f671da6881b0cf5&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1160178 Nov 21 13:55:18.808509 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-ecf89f29-ab38-4a92-942e-b49ae3b13f94 service neutron] 10.222.0.11 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1574178 Nov 21 13:55:18.874024 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8145dbc-ae9b-4626-a49f-c45e1ef08e51 admin admin] Router 33e387fa-f34a-4ac8-9676-eb7f363972f4 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:55:18.948000 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-46503072-c027-4021-972a-690bed9f335c service neutron] 10.222.0.11 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1307924 Nov 21 13:55:19.008316 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8145dbc-ae9b-4626-a49f-c45e1ef08e51 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:55:19.016451 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-d8145dbc-ae9b-4626-a49f-c45e1ef08e51 admin admin] 10.222.0.11 "PUT /v2.0/routers/33e387fa-f34a-4ac8-9676-eb7f363972f4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1179595 Nov 21 13:55:19.016628 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 54680) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:19.017726 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d0db709-6491-404f-92f3-eff10b5ab462 None None] Sync routers for ids ['33e387fa-f34a-4ac8-9676-eb7f363972f4'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:55:19.030984 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d0db709-6491-404f-92f3-eff10b5ab462 None None] Routers {'33e387fa-f34a-4ac8-9676-eb7f363972f4'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:55:19.031714 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-6d0db709-6491-404f-92f3-eff10b5ab462 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:55:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['33e387fa-f34a-4ac8-9676-eb7f363972f4'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:19.155143 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4203f309-7b06-4a65-b569-46039b1a34fa req-653c7fee-b167-4c0f-91bd-258c071a77bf tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 210 time: 0.0408211 Nov 21 13:55:19.174186 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Publish callbacks [] for router, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:19.248609 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-6d0db709-6491-404f-92f3-eff10b5ab462 None None] Set router 33e387fa-f34a-4ac8-9676-eb7f363972f4 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:19.291708 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:19.362359 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Deleting port 32a7269f-aa91-4f48-a140-c832f7cbd2f2 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:55:19.362698 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:19.464446 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-6d0db709-6491-404f-92f3-eff10b5ab462 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'name': 'tempest-ServerRescueNegativeTestJSON-367439327-router', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:42Z', 'updated_at': '2021-11-21T13:55:18Z', 'revision_number': 5, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'gw_port': {'id': '32a7269f-aa91-4f48-a140-c832f7cbd2f2', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:08:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:45Z', 'updated_at': '2021-11-21T13:51:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:19.468963 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] For port 32a7269f-aa91-4f48-a140-c832f7cbd2f2, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=32a7269f-aa91-4f48-a140-c832f7cbd2f2,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:19.469468 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:19.487547 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Calling delete_port for 32a7269f-aa91-4f48-a140-c832f7cbd2f2 owned by network:router_gateway {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:55:19.493598 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d0db709-6491-404f-92f3-eff10b5ab462 None None] Checking router: 33e387fa-f34a-4ac8-9676-eb7f363972f4 for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:55:19.503131 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d0db709-6491-404f-92f3-eff10b5ab462 None None] Routers {'33e387fa-f34a-4ac8-9676-eb7f363972f4'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:55:19.503909 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-6d0db709-6491-404f-92f3-eff10b5ab462 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:55:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['33e387fa-f34a-4ac8-9676-eb7f363972f4'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:19.601089 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-6d0db709-6491-404f-92f3-eff10b5ab462 None None] Set router 33e387fa-f34a-4ac8-9676-eb7f363972f4 gateway port host: None {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:19.633190 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b55a39a4-982e-436e-a5b4-8145413c0fbc req-146b9bc1-c74b-41cc-8520-3f52c60c086e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:19.640677 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b55a39a4-982e-436e-a5b4-8145413c0fbc req-146b9bc1-c74b-41cc-8520-3f52c60c086e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0615077 Nov 21 13:55:19.670482 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-6d0db709-6491-404f-92f3-eff10b5ab462 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'name': 'tempest-ServerRescueNegativeTestJSON-367439327-router', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:42Z', 'updated_at': '2021-11-21T13:55:19Z', 'revision_number': 6, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'gw_port_host': None}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:19.692432 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b55a39a4-982e-436e-a5b4-8145413c0fbc req-fff322cc-d7e7-4f26-9285-1bddd827264c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0506649 Nov 21 13:55:19.709959 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d0db709-6491-404f-92f3-eff10b5ab462 None None] The sync data for ids ['33e387fa-f34a-4ac8-9676-eb7f363972f4'] in dv-cinder-768458-12-iscsi is: [{'id': '33e387fa-f34a-4ac8-9676-eb7f363972f4', 'name': 'tempest-ServerRescueNegativeTestJSON-367439327-router', 'tenant_id': 'c90104f2696540809e93549d7ed3695f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:42Z', 'updated_at': '2021-11-21T13:55:19Z', 'revision_number': 6, 'project_id': 'c90104f2696540809e93549d7ed3695f', 'gw_port_host': None}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:55:19.930249 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:19.954891 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Pushing event deleted for resources: {'Port': ['ID=32a7269f-aa91-4f48-a140-c832f7cbd2f2,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:20.016032 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-471003'] for router_gateway, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.126864 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-470817', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-58426'] for router, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.129966 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.139996 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:55:20.163153 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:55:20.164560 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device e7a3f80b-e8c0-4dcd-ab0d-8b8fff7c20a5 not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:55:20.247719 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-470840'] for router, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.248295 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 33e387fa-f34a-4ac8-9676-eb7f363972f4 {{(pid=109041) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 21 13:55:20.283422 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] Publish callbacks [] for router, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.284580 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-5b56e6a7-71b7-45d5-b4ad-586320940d9d admin admin] 10.222.0.11 "DELETE /v2.0/routers/33e387fa-f34a-4ac8-9676-eb7f363972f4 HTTP/1.1" status: 204 len: 168 time: 1.2669849 Nov 21 13:55:20.286770 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-24090163-5a67-4b8a-a86a-8935e7ace22e req-8e3a740f-3f48-4c66-8c08-8f285e63fff2 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 210 time: 0.0425129 Nov 21 13:55:20.287540 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54696) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:20.328858 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-fe780034-838b-4210-89b0-359c29932d68 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:20.330268 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-fe780034-838b-4210-89b0-359c29932d68 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.50 "GET /v2.0/networks?id=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 HTTP/1.1" status: 200 len: 814 time: 0.1369684 Nov 21 13:55:20.337274 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_v2 [None req-9bdda983-cbba-47c1-b942-a3cf4cf53a91 admin admin] Deleting subnet a7f1c544-97e5-450d-9032-daf1d5a3a2a3 {{(pid=109040) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 13:55:20.340460 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9bdda983-cbba-47c1-b942-a3cf4cf53a91 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.347632 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-14eeb529-2ea8-49cd-8a70-8e3e47ef1b19 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Request body: {'port': {'device_id': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'admin_state_up': True, 'tenant_id': '406bef8592334a749f671da6881b0cf5'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:20.374931 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9bdda983-cbba-47c1-b942-a3cf4cf53a91 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.385047 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9bdda983-cbba-47c1-b942-a3cf4cf53a91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.444656 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9bdda983-cbba-47c1-b942-a3cf4cf53a91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for subnet, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.460627 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-14eeb529-2ea8-49cd-8a70-8e3e47ef1b19 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Made reservation on behalf of 406bef8592334a749f671da6881b0cf5 for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:55:20.464811 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-14eeb529-2ea8-49cd-8a70-8e3e47ef1b19 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.470769 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bdda983-cbba-47c1-b942-a3cf4cf53a91 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a7f1c544-97e5-450d-9032-daf1d5a3a2a3,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:20.473214 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9bdda983-cbba-47c1-b942-a3cf4cf53a91 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.476510 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-9bdda983-cbba-47c1-b942-a3cf4cf53a91 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/a7f1c544-97e5-450d-9032-daf1d5a3a2a3 HTTP/1.1" status: 204 len: 168 time: 0.1873147 Nov 21 13:55:20.478903 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54706) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:20.571389 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.612168 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 50c44d25-bd25-498f-8438-1dc33e1348ec no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:55:20.622554 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-14eeb529-2ea8-49cd-8a70-8e3e47ef1b19 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Allocated IP 172.20.0.8 (34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9/7cdb43d5-ad8a-4fcf-8b29-113b86f21514/0f9a92e8-efd7-45cc-b13f-25658f0506ad) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:55:20.657675 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: 50c44d25-bd25-498f-8438-1dc33e1348ec {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:55:20.658492 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 50c44d25-bd25-498f-8438-1dc33e1348ec not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:55:20.659064 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 32a7269f-aa91-4f48-a140-c832f7cbd2f2 no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:55:20.677544 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.694812 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: 32a7269f-aa91-4f48-a140-c832f7cbd2f2 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:55:20.695077 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 32a7269f-aa91-4f48-a140-c832f7cbd2f2 not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:55:20.718381 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.718824 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.719656 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.720091 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > port after_create 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.720519 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > port after_delete 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.721058 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > port after_update 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.721452 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.721864 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.722294 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.722630 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.809257 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-14eeb529-2ea8-49cd-8a70-8e3e47ef1b19 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.868420 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.869035 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.869374 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.869727 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=109040) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 21 13:55:20.870114 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a']}} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:20.882643 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-14eeb529-2ea8-49cd-8a70-8e3e47ef1b19 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.922658 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '87188554-865b-4f60-ac47-7f9dc768573f') {'for_net_delete': True} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:20.923078 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '87188554-865b-4f60-ac47-7f9dc768573f') {} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:20.943005 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-14eeb529-2ea8-49cd-8a70-8e3e47ef1b19 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:55:20.947488 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-261998924'] for segment, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:20.947662 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-14eeb529-2ea8-49cd-8a70-8e3e47ef1b19 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:55:20.962555 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-14eeb529-2ea8-49cd-8a70-8e3e47ef1b19 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:55:21.027482 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14eeb529-2ea8-49cd-8a70-8e3e47ef1b19 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event updated for resources: {'Port': ['ID=0f9a92e8-efd7-45cc-b13f-25658f0506ad,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:21.082728 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-14eeb529-2ea8-49cd-8a70-8e3e47ef1b19 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:21.083413 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-14eeb529-2ea8-49cd-8a70-8e3e47ef1b19 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:21.111614 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-14eeb529-2ea8-49cd-8a70-8e3e47ef1b19 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7678940 Nov 21 13:55:21.140604 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Request body: {'port': {'device_id': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:21.248772 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:21.278666 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:21.291769 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1709d0ea-4a37-4ebd-b6b6-fcdf8dc68616 req-509072ef-5fc7-4660-b6a3-e7aa8a5eb8f6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:21.299240 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1709d0ea-4a37-4ebd-b6b6-fcdf8dc68616 req-509072ef-5fc7-4660-b6a3-e7aa8a5eb8f6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.4234791 Nov 21 13:55:21.312168 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Releasing vlan 521 on physical network physnet1 to pool {{(pid=109040) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 13:55:21.312599 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2298122'] for segment, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: from cryptography.utils import int_from_bytes Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: from cryptography.utils import int_from_bytes Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: Traceback (most recent call last): Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: timer() Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: cb(*args, **kw) Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: return func(*args, **kwargs) Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: self._notify() Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: self.callback(batched_events) Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: event.method(event) Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: return f(self, *a, **k) Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._get(url).json() Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: return self.request(url, 'GET', **kwargs) Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 13:55:21.317413 dv-cinder-768458-12-iscsi neutron-server[109040]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 13:55:21.418102 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1709d0ea-4a37-4ebd-b6b6-fcdf8dc68616 req-9493864f-d664-46ba-ab02-5f88f499c21e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1178787 Nov 21 13:55:21.419362 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:21.437233 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-3dbf4838-7cba-45d7-9dc2-70cf6b15cdf4 None None] Provisioning complete for port 0f9a92e8-efd7-45cc-b13f-25658f0506ad triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:21.437857 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-3dbf4838-7cba-45d7-9dc2-70cf6b15cdf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:21.445878 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:21.459174 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] 10.222.0.11 "DELETE /v2.0/networks/63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a HTTP/1.1" status: 204 len: 168 time: 0.9790218 Nov 21 13:55:21.492155 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9899084f-4664-4928-896d-cc25d2683c76 admin admin] Pushing event deleted for resources: {'Network': ['ID=63c8b200-27f1-4b1d-9ca1-5e2bcfd4206a,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:21.511526 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-3dbf4838-7cba-45d7-9dc2-70cf6b15cdf4 None None] Port 0f9a92e8-efd7-45cc-b13f-25658f0506ad cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:55:21.620613 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-170edc4f-aca9-4a1b-8180-51db5eb8a740 req-26b26062-1179-4e95-8ec0-2b5ade1b8d80 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:21.622348 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-170edc4f-aca9-4a1b-8180-51db5eb8a740 req-26b26062-1179-4e95-8ec0-2b5ade1b8d80 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 931 time: 0.1974649 Nov 21 13:55:21.709713 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-170edc4f-aca9-4a1b-8180-51db5eb8a740 req-86941ff7-71ef-4fa3-9c2f-f667ba750f6b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0791781 Nov 21 13:55:21.799116 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54730) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:21.856069 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0f9a92e8-efd7-45cc-b13f-25658f0506ad {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:55:21.869929 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:21.886625 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Transition to ACTIVE for port object 0f9a92e8-efd7-45cc-b13f-25658f0506ad will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:55:21.894188 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:21.915313 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6552099d-fcee-4f52-961d-db2b09298677 req-77a5d637-95ca-4aff-8986-7d8f6e4399ae tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:21.917027 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-6552099d-fcee-4f52-961d-db2b09298677 req-77a5d637-95ca-4aff-8986-7d8f6e4399ae tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0947924 Nov 21 13:55:21.921105 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-b0d06a0a-1b80-4d14-a2a6-5d66c86cd021 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=c90104f2696540809e93549d7ed3695f&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1198893 Nov 21 13:55:21.924205 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54732) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:21.991558 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Pushing event updated for resources: {'Port': ['ID=0f9a92e8-efd7-45cc-b13f-25658f0506ad,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:22.044443 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-6552099d-fcee-4f52-961d-db2b09298677 req-0b1022de-e58f-4493-94ad-e57d7dbc410f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1140089 Nov 21 13:55:22.060373 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7fb82b99-1643-436c-9a7a-ed1b08bd5780 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:22.087508 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7fb82b99-1643-436c-9a7a-ed1b08bd5780 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:22.121337 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Attempting to bind port 0f9a92e8-efd7-45cc-b13f-25658f0506ad on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:55:22.121667 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Attempting to bind port 0f9a92e8-efd7-45cc-b13f-25658f0506ad by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:55:22.121992 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Attempting to bind port 0f9a92e8-efd7-45cc-b13f-25658f0506ad on network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:55:22.126641 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Port 0f9a92e8-efd7-45cc-b13f-25658f0506ad on network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:55:22.126965 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Attempting to bind port 0f9a92e8-efd7-45cc-b13f-25658f0506ad on network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:55:22.132104 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 54, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:55:22.132437 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Checking segment: {'id': '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:55:22.132821 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Bound using segment: {'id': '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:55:22.133251 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Bound port: 0f9a92e8-efd7-45cc-b13f-25658f0506ad, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:55:22.133605 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:22.144116 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7fb82b99-1643-436c-9a7a-ed1b08bd5780 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:22.146808 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7fb82b99-1643-436c-9a7a-ed1b08bd5780 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:22.151440 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-7fb82b99-1643-436c-9a7a-ed1b08bd5780 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/a8d8f563-6329-49d2-be60-2c66fef726e1 HTTP/1.1" status: 204 len: 168 time: 0.2244623 Nov 21 13:55:22.164653 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb82b99-1643-436c-9a7a-ed1b08bd5780 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8d8f563-6329-49d2-be60-2c66fef726e1,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:22.257361 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] For port 0f9a92e8-efd7-45cc-b13f-25658f0506ad, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:55:22.262378 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] For port 0f9a92e8-efd7-45cc-b13f-25658f0506ad, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=0f9a92e8-efd7-45cc-b13f-25658f0506ad,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:55:22.277561 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:22.327194 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:22.327844 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:22.329414 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] 10.222.0.50 "PUT /v2.0/ports/0f9a92e8-efd7-45cc-b13f-25658f0506ad HTTP/1.1" status: 200 len: 1093 time: 1.1976430 Nov 21 13:55:22.329864 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:55:22.332854 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df22fb5b-0b19-4a8c-a5bf-0c3eb81d898f" -d '{"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:55:22.381168 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68fe3460-dd37-44b2-a2b9-d1e3aa764859 service neutron] Pushing event updated for resources: {'Port': ['ID=0f9a92e8-efd7-45cc-b13f-25658f0506ad,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:22.391708 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:55:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f73524ff-0292-4cb1-839e-c5f1129986c4 x-openstack-request-id: req-f73524ff-0292-4cb1-839e-c5f1129986c4 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:55:22.392084 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:55:22.392347 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-f73524ff-0292-4cb1-839e-c5f1129986c4 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:55:22.392758 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad', 'status': 'completed', 'code': 200} Nov 21 13:55:22.560584 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:22.886110 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33506675-463c-4933-bbb2-7c4cc6568e85 req-e20fe7c5-8765-463b-baf0-8e4e97515f09 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:22.887630 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-33506675-463c-4933-bbb2-7c4cc6568e85 req-e20fe7c5-8765-463b-baf0-8e4e97515f09 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 943 time: 0.0754993 Nov 21 13:55:22.941676 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-33506675-463c-4933-bbb2-7c4cc6568e85 req-61751d28-6385-4f11-a5dd-54f4f7cf93fd tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450022 Nov 21 13:55:23.156509 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ba8315d-35be-41b0-90c8-091f4b51ad5d req-f3652d48-ab56-471b-bf3d-c9a9f2fd7081 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:23.158002 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7ba8315d-35be-41b0-90c8-091f4b51ad5d req-f3652d48-ab56-471b-bf3d-c9a9f2fd7081 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0504248 Nov 21 13:55:23.219235 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7ba8315d-35be-41b0-90c8-091f4b51ad5d req-41233ee0-eddf-4629-98f6-ab14409e7185 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0547221 Nov 21 13:55:24.123718 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132c62e0-3999-4c55-a1d5-6a938587af7e req-c55109a5-45b9-49ee-9df3-a8159b01b1d6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:24.125239 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-132c62e0-3999-4c55-a1d5-6a938587af7e req-c55109a5-45b9-49ee-9df3-a8159b01b1d6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 943 time: 0.0950623 Nov 21 13:55:24.180772 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-132c62e0-3999-4c55-a1d5-6a938587af7e req-e3766236-935b-4431-a157-a9f3119ffded tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470717 Nov 21 13:55:24.290826 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 54808) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:24.362935 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88f85bf7-130d-4c2b-a0e6-9f0a8d62f23d req-3422cf01-da28-4bb3-b668-e2356814babe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:24.365406 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-88f85bf7-130d-4c2b-a0e6-9f0a8d62f23d req-3422cf01-da28-4bb3-b668-e2356814babe tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0687816 Nov 21 13:55:24.441393 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-88f85bf7-130d-4c2b-a0e6-9f0a8d62f23d req-adf6167e-ee5b-455a-b8d2-b476ce5104ca tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0685942 Nov 21 13:55:24.442295 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ab144237-49d6-4b22-8199-007b3c10d81c admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:24.525492 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ab144237-49d6-4b22-8199-007b3c10d81c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:24.529312 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ab144237-49d6-4b22-8199-007b3c10d81c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:24.567050 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab144237-49d6-4b22-8199-007b3c10d81c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2372f6ce-e110-47d9-bec7-a3b5a331a148,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:24.575983 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-ab144237-49d6-4b22-8199-007b3c10d81c admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=2c965898bcf947098d25370c94af1a69&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2840099 Nov 21 13:55:24.576644 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 54812) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:24.627234 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-17d93438-49ae-4d41-ae29-8656ab0d737d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:24.652702 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-17d93438-49ae-4d41-ae29-8656ab0d737d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:24.703454 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-17d93438-49ae-4d41-ae29-8656ab0d737d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:24.706055 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-17d93438-49ae-4d41-ae29-8656ab0d737d admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:24.707249 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-17d93438-49ae-4d41-ae29-8656ab0d737d admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/2372f6ce-e110-47d9-bec7-a3b5a331a148 HTTP/1.1" status: 204 len: 168 time: 0.1296806 Nov 21 13:55:24.714918 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d93438-49ae-4d41-ae29-8656ab0d737d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2372f6ce-e110-47d9-bec7-a3b5a331a148,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:24.996869 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 54818) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:25.010006 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1404618f-7364-49f2-b845-c95318bc9e02 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:25.102549 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1404618f-7364-49f2-b845-c95318bc9e02 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:25.106399 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1404618f-7364-49f2-b845-c95318bc9e02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:25.146291 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-1404618f-7364-49f2-b845-c95318bc9e02 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=5e23600d5f9b417b858c77343b242b1c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1483147 Nov 21 13:55:25.147225 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1404618f-7364-49f2-b845-c95318bc9e02 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6cc84208-85cb-4d93-9884-3a57bb485842,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:25.149092 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 54820) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:25.199176 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e5d72d71-c98a-4eab-8e92-b81e28853d88 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:25.224775 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e5d72d71-c98a-4eab-8e92-b81e28853d88 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:25.319940 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e5d72d71-c98a-4eab-8e92-b81e28853d88 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:25.322518 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e5d72d71-c98a-4eab-8e92-b81e28853d88 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:25.326341 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-e5d72d71-c98a-4eab-8e92-b81e28853d88 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/6cc84208-85cb-4d93-9884-3a57bb485842 HTTP/1.1" status: 204 len: 168 time: 0.1735950 Nov 21 13:55:25.345312 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5d72d71-c98a-4eab-8e92-b81e28853d88 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6cc84208-85cb-4d93-9884-3a57bb485842,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:25.357174 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65df8cfe-71ee-4ec0-8555-3f3679a10ffc req-a1aadf3d-d508-4783-ac56-e6ee0212a99b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:25.358832 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-65df8cfe-71ee-4ec0-8555-3f3679a10ffc req-a1aadf3d-d508-4783-ac56-e6ee0212a99b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 943 time: 0.0921240 Nov 21 13:55:25.422559 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-65df8cfe-71ee-4ec0-8555-3f3679a10ffc req-b546eeca-94cf-4b5c-9f3f-5d34458b8bad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560689 Nov 21 13:55:25.587741 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7ed3769-1b70-4eb3-afe9-ca1a55b8b3f4 req-e41c4421-2285-4308-9edf-6d0ae9e72552 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:25.592669 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f7ed3769-1b70-4eb3-afe9-ca1a55b8b3f4 req-e41c4421-2285-4308-9edf-6d0ae9e72552 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0737102 Nov 21 13:55:25.616097 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:55:25.643391 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f7ed3769-1b70-4eb3-afe9-ca1a55b8b3f4 req-24d395ed-551b-4d9c-815f-d702f0cb6e79 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475359 Nov 21 13:55:26.553197 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ab34e42-8110-4096-a984-7ca7b96b1638 req-69ce67b8-639d-4267-95f2-3140221b6196 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:26.554828 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2ab34e42-8110-4096-a984-7ca7b96b1638 req-69ce67b8-639d-4267-95f2-3140221b6196 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 943 time: 0.0573189 Nov 21 13:55:26.616542 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2ab34e42-8110-4096-a984-7ca7b96b1638 req-fa9e42d9-1cc6-4524-9fd8-33ae96e145dd tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548141 Nov 21 13:55:26.766327 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b895ed1-7872-4d1b-8251-6568370ba27f req-1e1c7369-4481-41b6-b750-9c7cb69aff04 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:26.768012 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9b895ed1-7872-4d1b-8251-6568370ba27f req-1e1c7369-4481-41b6-b750-9c7cb69aff04 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0515573 Nov 21 13:55:26.825263 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9b895ed1-7872-4d1b-8251-6568370ba27f req-4b1b6c11-338a-4784-9414-40e76b93eba4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0484369 Nov 21 13:55:27.736073 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9cc5899-91c0-45a1-b248-52e9a12fce52 req-32963eb5-264f-4a64-a950-5b713b0aa429 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:27.737531 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c9cc5899-91c0-45a1-b248-52e9a12fce52 req-32963eb5-264f-4a64-a950-5b713b0aa429 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 943 time: 0.0516760 Nov 21 13:55:27.789732 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c9cc5899-91c0-45a1-b248-52e9a12fce52 req-790fa894-3ff9-4af9-83df-7d7383106cd2 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444102 Nov 21 13:55:27.947007 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20feee71-a282-4ff8-a5a5-d1d59dd1ee81 req-7c61d989-c39b-435a-b0fa-3a7a2022a718 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:27.948413 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-20feee71-a282-4ff8-a5a5-d1d59dd1ee81 req-7c61d989-c39b-435a-b0fa-3a7a2022a718 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0523529 Nov 21 13:55:27.999999 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-20feee71-a282-4ff8-a5a5-d1d59dd1ee81 req-d4efeb33-98eb-4d93-86dc-00bde60920cc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448055 Nov 21 13:55:28.918542 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ee9e8ff-ea3b-484c-a23a-0de854c3a1ea req-05b7e0f2-475d-4c63-9608-a87c34abc830 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:28.920029 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2ee9e8ff-ea3b-484c-a23a-0de854c3a1ea req-05b7e0f2-475d-4c63-9608-a87c34abc830 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 943 time: 0.0563724 Nov 21 13:55:28.969473 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2ee9e8ff-ea3b-484c-a23a-0de854c3a1ea req-cea46d90-b047-4925-a22e-a43a60a3c62e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434108 Nov 21 13:55:29.122112 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c8bf00-04c0-4b50-81e4-84ce32288bb4 req-1c3a10fc-32e7-4b03-890f-f352c3234936 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:29.123530 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-83c8bf00-04c0-4b50-81e4-84ce32288bb4 req-1c3a10fc-32e7-4b03-890f-f352c3234936 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0528529 Nov 21 13:55:29.176524 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-83c8bf00-04c0-4b50-81e4-84ce32288bb4 req-315717a6-a928-4520-a2d1-5ffbda97bda4 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462556 Nov 21 13:55:30.087210 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8435419-4d54-4156-8e85-700414c21bd6 req-f4f01e35-545d-419f-b487-b3de6403c6ce tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:30.088761 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d8435419-4d54-4156-8e85-700414c21bd6 req-f4f01e35-545d-419f-b487-b3de6403c6ce tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 943 time: 0.0516212 Nov 21 13:55:30.139828 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d8435419-4d54-4156-8e85-700414c21bd6 req-57546f64-8952-4d98-8864-9e06e5beb3c7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408227 Nov 21 13:55:30.166166 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-f6e4e44b-2a32-41ef-9102-171e7318d01c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:30.295289 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07e3f78-b4d2-480c-9a2c-271f44c0b17b req-c6b82d60-355c-4629-8e4a-61f468642d01 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:30.296770 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a07e3f78-b4d2-480c-9a2c-271f44c0b17b req-c6b82d60-355c-4629-8e4a-61f468642d01 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0491619 Nov 21 13:55:30.345283 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a07e3f78-b4d2-480c-9a2c-271f44c0b17b req-21ab0c86-5851-4553-9211-11bc983ff506 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425987 Nov 21 13:55:31.275747 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da541011-0a33-4f92-85f4-2c1ab7e486fa req-70c34bd8-cfc5-4bcb-8fa2-fa11fe4fbfaf tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:31.277456 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-da541011-0a33-4f92-85f4-2c1ab7e486fa req-70c34bd8-cfc5-4bcb-8fa2-fa11fe4fbfaf tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 943 time: 0.0520132 Nov 21 13:55:31.332528 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-da541011-0a33-4f92-85f4-2c1ab7e486fa req-d3a60ab8-08e7-4853-9c39-670c9878aca3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452609 Nov 21 13:55:31.465676 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1027f4ea-965b-4a08-98c7-39e9ee5ee1b3 req-3511ab04-2e68-46fc-916b-8c9a64f82233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:31.467150 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1027f4ea-965b-4a08-98c7-39e9ee5ee1b3 req-3511ab04-2e68-46fc-916b-8c9a64f82233 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0521786 Nov 21 13:55:31.519578 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1027f4ea-965b-4a08-98c7-39e9ee5ee1b3 req-a4f5b73e-6009-44e1-8db6-78c534ce80d9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449097 Nov 21 13:55:32.342656 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df22fb5b-0b19-4a8c-a5bf-0c3eb81d898f req-19e75442-d0b1-4dc0-a883-13db1d6bac96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:32.344270 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-df22fb5b-0b19-4a8c-a5bf-0c3eb81d898f req-19e75442-d0b1-4dc0-a883-13db1d6bac96 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=406bef8592334a749f671da6881b0cf5&device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 1096 time: 0.0438504 Nov 21 13:55:32.454799 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-521044cc-bfee-496f-ae8b-17fe2e3b920a req-c4adbff0-32ac-44de-bc5d-a087f28691ef tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:32.456902 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-521044cc-bfee-496f-ae8b-17fe2e3b920a req-c4adbff0-32ac-44de-bc5d-a087f28691ef tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 943 time: 0.0496647 Nov 21 13:55:32.461609 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 req-89947440-65d0-4a5f-95a4-c141eca740ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:32.463074 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 req-89947440-65d0-4a5f-95a4-c141eca740ab service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=389c281a19bb49e583633f57108f7f69&device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 1098 time: 0.0997462 Nov 21 13:55:32.508668 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-521044cc-bfee-496f-ae8b-17fe2e3b920a req-35b12247-065d-42d0-b4cf-6ea96230a1d3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454152 Nov 21 13:55:32.535051 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df22fb5b-0b19-4a8c-a5bf-0c3eb81d898f req-12d1f801-2d34-4ffa-a69f-801e2ff1f013 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:32.536528 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-df22fb5b-0b19-4a8c-a5bf-0c3eb81d898f req-12d1f801-2d34-4ffa-a69f-801e2ff1f013 service neutron] 10.222.0.50 "GET /v2.0/networks?tenant_id=406bef8592334a749f671da6881b0cf5&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1620779 Nov 21 13:55:32.562843 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6877e6a8-fceb-4630-86aa-4c28e4c687ca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:32.648974 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 req-38a75af3-214b-4a71-8431-60bd5d75f01e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:32.650404 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 req-38a75af3-214b-4a71-8431-60bd5d75f01e service neutron] 10.222.0.50 "GET /v2.0/networks?id=ea19090b-8034-4904-8b6c-1752befe0b5a HTTP/1.1" status: 200 len: 912 time: 0.1784434 Nov 21 13:55:32.731873 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9441656a-4099-467e-81f9-6663acce6e49 req-73c01f54-3557-4d6f-9751-296907c99ba6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:32.733237 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9441656a-4099-467e-81f9-6663acce6e49 req-73c01f54-3557-4d6f-9751-296907c99ba6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.1298795 Nov 21 13:55:32.756978 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df22fb5b-0b19-4a8c-a5bf-0c3eb81d898f req-b306ae52-fa8f-4a33-89ae-297487437ec7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:32.758332 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-df22fb5b-0b19-4a8c-a5bf-0c3eb81d898f req-b306ae52-fa8f-4a33-89ae-297487437ec7 service neutron] 10.222.0.50 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2121046 Nov 21 13:55:32.776393 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 req-bfe01379-ae6f-4988-b95b-d941a34af40e service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=e97fd0d3-216a-4615-aa4a-a98857cba123 HTTP/1.1" status: 200 len: 1001 time: 0.1178896 Nov 21 13:55:32.843546 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9441656a-4099-467e-81f9-6663acce6e49 req-9e7a06ce-6404-4569-87cc-c7ada11871eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1021602 Nov 21 13:55:32.866039 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 req-27792033-7f31-43a5-bf5b-d2daf17e6da6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:32.867478 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 req-27792033-7f31-43a5-bf5b-d2daf17e6da6 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0 HTTP/1.1" status: 200 len: 850 time: 0.0795829 Nov 21 13:55:32.873295 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-93bdc8f7-07e3-4e78-9aa9-048d0eda9621 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:32.874611 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-93bdc8f7-07e3-4e78-9aa9-048d0eda9621 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=406bef8592334a749f671da6881b0cf5&device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 1096 time: 0.0755277 Nov 21 13:55:32.933981 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-15f9c9f1-36c6-4da9-8ef2-e42702f19e89 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0f9a92e8-efd7-45cc-b13f-25658f0506ad HTTP/1.1" status: 200 len: 217 time: 0.0494156 Nov 21 13:55:32.971743 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 req-8cf2f836-35ac-4d66-9875-4184bbff1abf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:32.973246 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 req-8cf2f836-35ac-4d66-9875-4184bbff1abf service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=ea19090b-8034-4904-8b6c-1752befe0b5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0977919 Nov 21 13:55:33.030667 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-87b02db9-7b01-482e-9ad0-249496448d11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:33.032081 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-87b02db9-7b01-482e-9ad0-249496448d11 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=7cdb43d5-ad8a-4fcf-8b29-113b86f21514 HTTP/1.1" status: 200 len: 853 time: 0.0894217 Nov 21 13:55:33.099983 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 req-af208404-6220-45a6-b86a-ab1b9e893fa2 service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1176631 Nov 21 13:55:33.104229 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-ef8582d3-f48f-488f-9409-e6065a3e25a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:33.105579 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-ef8582d3-f48f-488f-9409-e6065a3e25a0 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0641942 Nov 21 13:55:33.254194 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-937fccde-cacf-4fbe-9e40-b6ed954a71a1 req-dfe74507-d3da-4e47-97be-c0111d92be5a service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1469820 Nov 21 13:55:33.257472 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-3a4cb641-ec63-4989-9e82-e12817215830 service neutron] 10.222.0.50 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1415756 Nov 21 13:55:33.352356 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e2bb76d0-9d48-4f03-9eeb-72c69373ba36 req-ebabc3b7-b0ea-453b-9e72-32db5062a68a service neutron] 10.222.0.50 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843556 Nov 21 13:55:33.621831 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1c42a2e-93e7-4db9-aefe-d2a8a3b500a8 req-fef423a3-c714-4dc1-aff5-657db39b988e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:33.623346 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f1c42a2e-93e7-4db9-aefe-d2a8a3b500a8 req-fef423a3-c714-4dc1-aff5-657db39b988e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 943 time: 0.0493326 Nov 21 13:55:33.673729 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f1c42a2e-93e7-4db9-aefe-d2a8a3b500a8 req-e7dce3f0-6cf8-4e9c-9f92-68bc0b028c5d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437424 Nov 21 13:55:33.867484 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:33.957326 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dcb70aa-8f46-46bb-9cef-ac312b9c0709 req-d0021ca0-e6a5-4a51-ad2f-bd2aef766ef2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:33.958753 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7dcb70aa-8f46-46bb-9cef-ac312b9c0709 req-d0021ca0-e6a5-4a51-ad2f-bd2aef766ef2 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0479944 Nov 21 13:55:34.005136 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7dcb70aa-8f46-46bb-9cef-ac312b9c0709 req-e1f615ec-3ede-47b1-bbb0-a8000b3d1070 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405302 Nov 21 13:55:34.785660 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bdc1cb0-242d-4f3b-84d4-8f38f90aa644 req-2912f1e0-094f-49cf-a752-ab0b0c240322 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:34.787095 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7bdc1cb0-242d-4f3b-84d4-8f38f90aa644 req-2912f1e0-094f-49cf-a752-ab0b0c240322 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 943 time: 0.0478482 Nov 21 13:55:34.839174 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7bdc1cb0-242d-4f3b-84d4-8f38f90aa644 req-6c4975aa-5576-40d1-b12e-8fd8542e6514 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461378 Nov 21 13:55:35.062138 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:35.844560 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:35.948807 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed04288-ab14-4fbb-9e26-b516cafba0e1 req-9b452dc6-32e4-4807-b473-3b3aac123af6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:35.950224 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4ed04288-ab14-4fbb-9e26-b516cafba0e1 req-9b452dc6-32e4-4807-b473-3b3aac123af6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 943 time: 0.0497568 Nov 21 13:55:35.995527 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4ed04288-ab14-4fbb-9e26-b516cafba0e1 req-8737f3ec-2fad-4d50-880e-2ede50f8cfe7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394456 Nov 21 13:55:36.228327 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 0f9a92e8-efd7-45cc-b13f-25658f0506ad details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:55:36.323106 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 0f9a92e8-efd7-45cc-b13f-25658f0506ad, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=0f9a92e8-efd7-45cc-b13f-25658f0506ad,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:36.335398 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '0f9a92e8-efd7-45cc-b13f-25658f0506ad', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'port_id': '0f9a92e8-efd7-45cc-b13f-25658f0506ad', 'mac_address': 'fa:16:3e:84:7f:14', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 504, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:55:36.371588 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:36.385752 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0f9a92e8-efd7-45cc-b13f-25658f0506ad {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:55:36.406497 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 0f9a92e8-efd7-45cc-b13f-25658f0506ad, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=0f9a92e8-efd7-45cc-b13f-25658f0506ad,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:36.410959 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:36.460339 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=0f9a92e8-efd7-45cc-b13f-25658f0506ad,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:36.467250 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:36.467623 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:36.468088 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:36.468404 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:36.468743 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:36.469095 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:36.469432 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:36.469763 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:36.470095 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:36.470418 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:36.470741 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:36.471065 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:36.666005 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['0f9a92e8-efd7-45cc-b13f-25658f0506ad'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:55:37.109024 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b934c18-95f7-4455-9d2b-3df80b54c0a4 req-18cf648c-b5ac-44b5-9a53-c6aef378d5dd tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:37.110451 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5b934c18-95f7-4455-9d2b-3df80b54c0a4 req-18cf648c-b5ac-44b5-9a53-c6aef378d5dd tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 944 time: 0.0503800 Nov 21 13:55:37.156551 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5b934c18-95f7-4455-9d2b-3df80b54c0a4 req-31b4a7a9-374f-4280-95c1-5ad4fb3bcf99 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395789 Nov 21 13:55:38.230886 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 0f9a92e8-efd7-45cc-b13f-25658f0506ad up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:55:38.267719 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-812ba67b-dd2b-48ce-9254-5be8a3667432 req-d4ef76ed-7a7f-4746-8b4b-5c71538fb4e7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:38.269732 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-812ba67b-dd2b-48ce-9254-5be8a3667432 req-d4ef76ed-7a7f-4746-8b4b-5c71538fb4e7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 944 time: 0.0481558 Nov 21 13:55:38.280657 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port 0f9a92e8-efd7-45cc-b13f-25658f0506ad completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:55:38.285602 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 0f9a92e8-efd7-45cc-b13f-25658f0506ad triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:38.285975 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:38.317998 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-812ba67b-dd2b-48ce-9254-5be8a3667432 req-d74958e9-69c3-4276-9b71-90d720f68886 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416381 Nov 21 13:55:38.364949 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:38.387133 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:55:38.389381 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc4b36c6-124c-4ee2-b966-1c79b7c2f102" -d '{"events": [{"server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "name": "network-vif-plugged", "status": "completed", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:55:38.401702 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 0f9a92e8-efd7-45cc-b13f-25658f0506ad, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=0f9a92e8-efd7-45cc-b13f-25658f0506ad,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:38.405250 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:38.430322 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:55:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-45bfa8bc-12c7-44cd-a0ce-6c446a9fd7d9 x-openstack-request-id: req-45bfa8bc-12c7-44cd-a0ce-6c446a9fd7d9 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:55:38.430620 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "name": "network-vif-plugged", "status": "completed", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:55:38.430880 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-45bfa8bc-12c7-44cd-a0ce-6c446a9fd7d9 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:55:38.431273 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad', 'code': 200} Nov 21 13:55:38.455934 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=0f9a92e8-efd7-45cc-b13f-25658f0506ad,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:38.599327 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43638f88-9000-4611-a41a-eed0a89bc97c req-bcd8614c-df25-4662-8d6b-6c6ec9269e31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:38.600870 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-43638f88-9000-4611-a41a-eed0a89bc97c req-bcd8614c-df25-4662-8d6b-6c6ec9269e31 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 1098 time: 0.0382123 Nov 21 13:55:38.646546 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-43638f88-9000-4611-a41a-eed0a89bc97c req-541f9cba-ef46-470e-9363-5e3fa9a95c42 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385399 Nov 21 13:55:39.429055 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ac7b2cc-255c-459b-9576-b921480f5e45 req-9efce195-9938-4fa2-800b-a23639a4e162 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:39.431086 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2ac7b2cc-255c-459b-9576-b921480f5e45 req-9efce195-9938-4fa2-800b-a23639a4e162 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 945 time: 0.0476100 Nov 21 13:55:39.476638 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2ac7b2cc-255c-459b-9576-b921480f5e45 req-b8c15685-0bda-4daf-bedc-bc9a9a74228d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399764 Nov 21 13:55:40.605954 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36ab2108-2881-4c44-aa49-61bc6619ad98 req-65d57506-f1bd-4e24-901f-c70feb7e75ed tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:40.607573 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-36ab2108-2881-4c44-aa49-61bc6619ad98 req-65d57506-f1bd-4e24-901f-c70feb7e75ed tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 945 time: 0.0539603 Nov 21 13:55:40.656721 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-36ab2108-2881-4c44-aa49-61bc6619ad98 req-80f7fe2f-86fc-43b1-a4ba-d708d5bcfbd3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429385 Nov 21 13:55:40.774221 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2acafa08-a817-4c2c-8635-277f5e8d6580 req-8b23d207-e993-49fe-aee9-c81df62a3702 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:40.775652 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2acafa08-a817-4c2c-8635-277f5e8d6580 req-8b23d207-e993-49fe-aee9-c81df62a3702 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 945 time: 0.0495553 Nov 21 13:55:40.821077 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2acafa08-a817-4c2c-8635-277f5e8d6580 req-44adb324-29b5-4589-b317-d5d78c2437ae tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393884 Nov 21 13:55:41.141868 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fe01e53-b4bc-4a73-aa4c-670a19d58f10 req-e495a25f-dff9-442d-b5f5-9f19dcc3bc7a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:41.143330 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4fe01e53-b4bc-4a73-aa4c-670a19d58f10 req-e495a25f-dff9-442d-b5f5-9f19dcc3bc7a tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 945 time: 0.0520957 Nov 21 13:55:41.188815 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4fe01e53-b4bc-4a73-aa4c-670a19d58f10 req-ed92765c-165e-4a78-8d46-35c72fb9e1b7 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395374 Nov 21 13:55:41.807512 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55098) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:41.911968 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7ab8ba83-972d-47b5-8529-de8f7e905011 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:41.985742 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7ab8ba83-972d-47b5-8529-de8f7e905011 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:41.989496 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7ab8ba83-972d-47b5-8529-de8f7e905011 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:42.028502 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ab8ba83-972d-47b5-8529-de8f7e905011 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=10e871d4-2eba-433a-8087-bf4b0c4ccc0a,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:42.032695 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-7ab8ba83-972d-47b5-8529-de8f7e905011 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=4902aa7037c84bd7bb6ae62897ff77b2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2241387 Nov 21 13:55:42.035885 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55104) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:42.080682 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e03b68b6-db2d-443b-b1c0-fd9c7d0f8ba2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:42.101691 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e03b68b6-db2d-443b-b1c0-fd9c7d0f8ba2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:42.154291 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e03b68b6-db2d-443b-b1c0-fd9c7d0f8ba2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:42.157427 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e03b68b6-db2d-443b-b1c0-fd9c7d0f8ba2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:42.158582 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-e03b68b6-db2d-443b-b1c0-fd9c7d0f8ba2 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/10e871d4-2eba-433a-8087-bf4b0c4ccc0a HTTP/1.1" status: 204 len: 168 time: 0.1217959 Nov 21 13:55:42.167096 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e03b68b6-db2d-443b-b1c0-fd9c7d0f8ba2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=10e871d4-2eba-433a-8087-bf4b0c4ccc0a,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:42.409085 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55110) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:42.421849 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ccac91c3-3e17-4f73-8917-15424172d2f4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:42.494707 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ccac91c3-3e17-4f73-8917-15424172d2f4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:42.499641 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ccac91c3-3e17-4f73-8917-15424172d2f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:42.541515 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-ccac91c3-3e17-4f73-8917-15424172d2f4 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=89fe448d72f6411e8e64d9a4388f8204&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1313357 Nov 21 13:55:42.542438 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccac91c3-3e17-4f73-8917-15424172d2f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a7b2e3d4-5d03-4aef-ae02-57693efc754b,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:42.544637 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55114) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:42.592029 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-606f720f-453f-4e22-b2df-5a1f0ea0f061 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:42.613534 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-606f720f-453f-4e22-b2df-5a1f0ea0f061 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:42.658966 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-606f720f-453f-4e22-b2df-5a1f0ea0f061 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:42.661263 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-606f720f-453f-4e22-b2df-5a1f0ea0f061 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:42.662401 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-606f720f-453f-4e22-b2df-5a1f0ea0f061 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/a7b2e3d4-5d03-4aef-ae02-57693efc754b HTTP/1.1" status: 204 len: 168 time: 0.1167791 Nov 21 13:55:42.670309 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-606f720f-453f-4e22-b2df-5a1f0ea0f061 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a7b2e3d4-5d03-4aef-ae02-57693efc754b,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:51.771883 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-173d74f4-3c70-4b0d-a01e-717054db805a req-944556b9-5f23-45ca-a15c-f4d37cf0405c tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:51.773346 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-173d74f4-3c70-4b0d-a01e-717054db805a req-944556b9-5f23-45ca-a15c-f4d37cf0405c tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 945 time: 0.0474961 Nov 21 13:55:51.822891 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-173d74f4-3c70-4b0d-a01e-717054db805a req-0b19229c-1d2c-4b45-97d8-d318c1cfa0c1 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436935 Nov 21 13:55:51.846964 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55284) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:52.033545 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e59876f3-db87-4f33-a9fb-77951446dadc tempest-TestMinimumBasicScenario-1862136853 tempest-TestMinimumBasicScenario-1862136853-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:52.035067 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-e59876f3-db87-4f33-a9fb-77951446dadc tempest-TestMinimumBasicScenario-1862136853 tempest-TestMinimumBasicScenario-1862136853-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 1093 time: 0.1870587 Nov 21 13:55:52.037924 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55288) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:52.042043 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Request body: {'floatingip': {'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'port_id': '0f9a92e8-efd7-45cc-b13f-25658f0506ad', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'fixed_ip_address': '172.20.0.8'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:52.063544 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for floatingip, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:52.164167 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:52.272446 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Allocated IP 172.27.1.13 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/f6ee5d13-8a33-47b6-9511-a990b3947850) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:55:52.500419 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-425b7ef3-ec0c-4a0b-9d98-ef9f98d534c9 req-4e7b0fa9-e82c-4caf-9a7c-ef646433f452 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:52.501882 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-425b7ef3-ec0c-4a0b-9d98-ef9f98d534c9 req-4e7b0fa9-e82c-4caf-9a7c-ef646433f452 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 947 time: 0.0579898 Nov 21 13:55:52.551451 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-425b7ef3-ec0c-4a0b-9d98-ef9f98d534c9 req-8ee0a409-88a6-41f1-a55e-50ff7c99d542 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427010 Nov 21 13:55:52.580432 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:52.636700 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:52.667423 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:52.704403 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:55:52.707199 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:55:52.710738 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:55:52.736414 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event updated for resources: {'Port': ['ID=f6ee5d13-8a33-47b6-9511-a990b3947850,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:53.080560 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:53.153277 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:53.306197 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:53.310549 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:53.383209 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event updated for resources: {'Port': ['ID=f6ee5d13-8a33-47b6-9511-a990b3947850,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:53.390970 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:53.495532 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.l3_db [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Floating IP e3393974-141a-4a0e-93e6-13bbaff6459b associated. External IP: 172.27.1.13, port: 0f9a92e8-efd7-45cc-b13f-25658f0506ad. Nov 21 13:55:53.769205 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8541a54f-3d87-49e1-88a7-18629d2ed2dc req-4f657da1-5941-4e21-907d-8ccb6e4715c1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:53.770673 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8541a54f-3d87-49e1-88a7-18629d2ed2dc req-4f657da1-5941-4e21-907d-8ccb6e4715c1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 947 time: 0.1349413 Nov 21 13:55:53.796784 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Router 97eb221f-bbef-4cab-b393-a7606b8c7477 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:55:53.866755 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8541a54f-3d87-49e1-88a7-18629d2ed2dc req-8d9f6d7f-33eb-45e2-b49f-b0da5dc64dc2 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0895464 Nov 21 13:55:53.927513 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:55:53.936899 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f3a4b78-aa8d-4496-8c8a-b39f789ff2da None None] Sync routers for ids ['97eb221f-bbef-4cab-b393-a7606b8c7477'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:55:53.945823 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:53.947543 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f3a4b78-aa8d-4496-8c8a-b39f789ff2da None None] Routers {'97eb221f-bbef-4cab-b393-a7606b8c7477'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:55:53.948292 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8f3a4b78-aa8d-4496-8c8a-b39f789ff2da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:55:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['97eb221f-bbef-4cab-b393-a7606b8c7477'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:53.972215 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-b99e7bd8-60da-427e-803c-f679b2d7e817 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.9332576 Nov 21 13:55:53.972887 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:55:53.975242 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f176665b-668a-4212-af16-50c7d9a60dcb" -d '{"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:55:53.975524 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55314) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:53.980911 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-882500e6-0d63-4c65-9313-aa13d7c3af63 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-858840109', 'description': 'tempest-secgroup-smoke-858840109 description', 'project_id': '406bef8592334a749f671da6881b0cf5'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:54.019722 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:55:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c96d005-8ae0-4cc0-9814-049127b2fa5e x-openstack-request-id: req-5c96d005-8ae0-4cc0-9814-049127b2fa5e {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:55:54.020140 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:55:54.020462 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-5c96d005-8ae0-4cc0-9814-049127b2fa5e {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:55:54.020947 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad', 'status': 'completed', 'code': 200} Nov 21 13:55:54.028268 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-882500e6-0d63-4c65-9313-aa13d7c3af63 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.065791 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-8f3a4b78-aa8d-4496-8c8a-b39f789ff2da None None] Set router 97eb221f-bbef-4cab-b393-a7606b8c7477 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:54.113532 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-882500e6-0d63-4c65-9313-aa13d7c3af63 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.114659 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f176665b-668a-4212-af16-50c7d9a60dcb req-d76e1215-44bf-4b9a-aa8f-e8251961f970 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:54.116283 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f176665b-668a-4212-af16-50c7d9a60dcb req-d76e1215-44bf-4b9a-aa8f-e8251961f970 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=406bef8592334a749f671da6881b0cf5&device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 1098 time: 0.0632451 Nov 21 13:55:54.119247 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-882500e6-0d63-4c65-9313-aa13d7c3af63 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.153208 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-882500e6-0d63-4c65-9313-aa13d7c3af63 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.157656 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-882500e6-0d63-4c65-9313-aa13d7c3af63 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1804497 Nov 21 13:55:54.159935 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55328) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:54.164695 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-58cbcb3b-62ee-4486-bb25-0eb3ef686dad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Request body: {'security_group_rule': {'security_group_id': '42126e3d-39be-4ee1-969d-6af11887f875', 'project_id': '406bef8592334a749f671da6881b0cf5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:54.170687 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-882500e6-0d63-4c65-9313-aa13d7c3af63 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event updated for resources: {'SecurityGroup': ['ID=42126e3d-39be-4ee1-969d-6af11887f875,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:54.210945 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-58cbcb3b-62ee-4486-bb25-0eb3ef686dad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.230851 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f176665b-668a-4212-af16-50c7d9a60dcb req-3a5f2755-f8eb-4b02-8a81-d36b5b9a5330 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:54.233399 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f176665b-668a-4212-af16-50c7d9a60dcb req-3a5f2755-f8eb-4b02-8a81-d36b5b9a5330 service neutron] 10.222.0.50 "GET /v2.0/networks?id=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 HTTP/1.1" status: 200 len: 915 time: 0.1088431 Nov 21 13:55:54.282846 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-58cbcb3b-62ee-4486-bb25-0eb3ef686dad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.289059 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-58cbcb3b-62ee-4486-bb25-0eb3ef686dad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.307840 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58cbcb3b-62ee-4486-bb25-0eb3ef686dad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c761c0c9-ecc1-414a-9b37-11b76ef41e99,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:54.320227 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f176665b-668a-4212-af16-50c7d9a60dcb req-33d0ffa1-bbad-4149-9063-e6fab7261a38 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0f9a92e8-efd7-45cc-b13f-25658f0506ad HTTP/1.1" status: 200 len: 998 time: 0.0750058 Nov 21 13:55:54.321444 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-58cbcb3b-62ee-4486-bb25-0eb3ef686dad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.325234 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-58cbcb3b-62ee-4486-bb25-0eb3ef686dad tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1617289 Nov 21 13:55:54.325958 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55334) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:54.335384 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-6205c7ba-d429-48eb-86c2-74c65f3a093d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Request body: {'security_group_rule': {'security_group_id': '42126e3d-39be-4ee1-969d-6af11887f875', 'project_id': '406bef8592334a749f671da6881b0cf5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:54.368828 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6205c7ba-d429-48eb-86c2-74c65f3a093d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.400840 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f176665b-668a-4212-af16-50c7d9a60dcb req-6a4c4ec0-2d2a-4ead-beca-42eccdb5983c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:54.402344 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f176665b-668a-4212-af16-50c7d9a60dcb req-6a4c4ec0-2d2a-4ead-beca-42eccdb5983c service neutron] 10.222.0.50 "GET /v2.0/subnets?id=7cdb43d5-ad8a-4fcf-8b29-113b86f21514 HTTP/1.1" status: 200 len: 853 time: 0.0587339 Nov 21 13:55:54.410802 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-d4866716-991a-4eb1-a26b-c224cb3cf357 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:54.412270 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-d4866716-991a-4eb1-a26b-c224cb3cf357 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.50 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 947 time: 0.1774471 Nov 21 13:55:54.412621 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8f3a4b78-aa8d-4496-8c8a-b39f789ff2da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38'}], 'enable_snat': True}, 'gw_port_id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:01Z', 'revision_number': 4, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port': {'id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:b6:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'e3393974-141a-4a0e-93e6-13bbaff6459b', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'floating_ip_address': '172.27.1.13', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'port_id': '0f9a92e8-efd7-45cc-b13f-25658f0506ad', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 467, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'mac_address': 'fa:16:3e:84:7f:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:55:52Z', 'updated_at': '2021-11-21T13:55:52Z', 'revision_number': 0, 'project_id': '406bef8592334a749f671da6881b0cf5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd03b886a-1564-44d9-a5a2-34ff7929ef4b', 'name': '', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'mac_address': 'fa:16:3e:23:78:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:00Z', 'updated_at': '2021-11-21T13:55:05Z', 'revision_number': 5, 'project_id': '406bef8592334a749f671da6881b0cf5', 'subnets': [{'id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:54.448627 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f3a4b78-aa8d-4496-8c8a-b39f789ff2da None None] Checking router: 97eb221f-bbef-4cab-b393-a7606b8c7477 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:55:54.453693 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6205c7ba-d429-48eb-86c2-74c65f3a093d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.459110 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f3a4b78-aa8d-4496-8c8a-b39f789ff2da None None] Routers {'97eb221f-bbef-4cab-b393-a7606b8c7477'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:55:54.459597 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6205c7ba-d429-48eb-86c2-74c65f3a093d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.459720 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8f3a4b78-aa8d-4496-8c8a-b39f789ff2da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:55:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['97eb221f-bbef-4cab-b393-a7606b8c7477'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:54.486648 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6205c7ba-d429-48eb-86c2-74c65f3a093d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.491057 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-6205c7ba-d429-48eb-86c2-74c65f3a093d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1640277 Nov 21 13:55:54.493410 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55338) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:54.497984 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-4ad7429b-e074-491f-8489-28de9ab6ced2 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Request body: {'security_group_rule': {'security_group_id': '42126e3d-39be-4ee1-969d-6af11887f875', 'project_id': '406bef8592334a749f671da6881b0cf5', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:54.506758 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6205c7ba-d429-48eb-86c2-74c65f3a093d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bed2562a-c8d3-45fd-8ab0-8f84a8533828,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:54.515011 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f176665b-668a-4212-af16-50c7d9a60dcb req-d36c3c65-7964-4ff6-9238-2f6bcedaced7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:54.516641 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f176665b-668a-4212-af16-50c7d9a60dcb req-d36c3c65-7964-4ff6-9238-2f6bcedaced7 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.1034255 Nov 21 13:55:54.540248 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4ad7429b-e074-491f-8489-28de9ab6ced2 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.573401 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55340) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:54.579385 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-8f3a4b78-aa8d-4496-8c8a-b39f789ff2da None None] Set router 97eb221f-bbef-4cab-b393-a7606b8c7477 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:54.602577 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Deleting port 627d561d-d2ff-449e-a99f-9e5e3fd874ba {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:55:54.602925 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.607591 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4ad7429b-e074-491f-8489-28de9ab6ced2 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.616964 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4ad7429b-e074-491f-8489-28de9ab6ced2 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.638009 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ad7429b-e074-491f-8489-28de9ab6ced2 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0a1df104-eab6-42ad-b6f3-9404003eae1f,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:54.650692 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4ad7429b-e074-491f-8489-28de9ab6ced2 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.655355 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-4ad7429b-e074-491f-8489-28de9ab6ced2 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1609221 Nov 21 13:55:54.655552 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55344) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:54.668013 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-47839d4a-3b80-4c80-ab98-4933dbcedee8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Request body: {'security_group_rule': {'security_group_id': '42126e3d-39be-4ee1-969d-6af11887f875', 'project_id': '406bef8592334a749f671da6881b0cf5', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:54.686678 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f176665b-668a-4212-af16-50c7d9a60dcb req-a98c61d9-a740-4d14-98c3-0cdd8a2d0b21 service neutron] 10.222.0.50 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1604099 Nov 21 13:55:54.742464 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6b87503c-33d0-41a0-ac33-81a14cc8a63d admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.782690 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-47839d4a-3b80-4c80-ab98-4933dbcedee8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.829568 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6b87503c-33d0-41a0-ac33-81a14cc8a63d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.833832 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8f3a4b78-aa8d-4496-8c8a-b39f789ff2da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38'}], 'enable_snat': True}, 'gw_port_id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:01Z', 'revision_number': 4, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port': {'id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:b6:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'e3393974-141a-4a0e-93e6-13bbaff6459b', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'floating_ip_address': '172.27.1.13', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'port_id': '0f9a92e8-efd7-45cc-b13f-25658f0506ad', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 467, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'mac_address': 'fa:16:3e:84:7f:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:55:52Z', 'updated_at': '2021-11-21T13:55:52Z', 'revision_number': 0, 'project_id': '406bef8592334a749f671da6881b0cf5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd03b886a-1564-44d9-a5a2-34ff7929ef4b', 'name': '', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'mac_address': 'fa:16:3e:23:78:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:00Z', 'updated_at': '2021-11-21T13:55:05Z', 'revision_number': 5, 'project_id': '406bef8592334a749f671da6881b0cf5', 'subnets': [{'id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:54.834354 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6b87503c-33d0-41a0-ac33-81a14cc8a63d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.845795 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] For port 627d561d-d2ff-449e-a99f-9e5e3fd874ba, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=627d561d-d2ff-449e-a99f-9e5e3fd874ba,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:54.846621 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.867716 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f176665b-668a-4212-af16-50c7d9a60dcb req-17d880ff-576c-4da0-8f59-4fcb3833ffa4 service neutron] 10.222.0.50 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1720288 Nov 21 13:55:54.878791 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-6b87503c-33d0-41a0-ac33-81a14cc8a63d admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=6c2b0f65508d46e1ac64abebed5b6ac3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3026462 Nov 21 13:55:54.879454 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55346) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:54.886338 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b87503c-33d0-41a0-ac33-81a14cc8a63d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=144b6006-04a8-4476-94df-a590a624cc2e,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:54.950090 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7956f63a-0f07-45a1-b19d-84919c08d408 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.972973 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-47839d4a-3b80-4c80-ab98-4933dbcedee8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.981816 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7956f63a-0f07-45a1-b19d-84919c08d408 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.985898 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-47839d4a-3b80-4c80-ab98-4933dbcedee8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:54.991462 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f3a4b78-aa8d-4496-8c8a-b39f789ff2da None None] The sync data for ids ['97eb221f-bbef-4cab-b393-a7606b8c7477'] in dv-cinder-768458-12-iscsi is: [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38'}], 'enable_snat': True}, 'gw_port_id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:01Z', 'revision_number': 4, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port': {'id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:b6:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'e3393974-141a-4a0e-93e6-13bbaff6459b', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'floating_ip_address': '172.27.1.13', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'port_id': '0f9a92e8-efd7-45cc-b13f-25658f0506ad', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 467, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'mac_address': 'fa:16:3e:84:7f:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:55:52Z', 'updated_at': '2021-11-21T13:55:52Z', 'revision_number': 0, 'project_id': '406bef8592334a749f671da6881b0cf5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd03b886a-1564-44d9-a5a2-34ff7929ef4b', 'name': '', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'mac_address': 'fa:16:3e:23:78:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:00Z', 'updated_at': '2021-11-21T13:55:05Z', 'revision_number': 5, 'project_id': '406bef8592334a749f671da6881b0cf5', 'subnets': [{'id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:55:55.040916 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7956f63a-0f07-45a1-b19d-84919c08d408 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.044086 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7956f63a-0f07-45a1-b19d-84919c08d408 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.047644 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-7956f63a-0f07-45a1-b19d-84919c08d408 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/144b6006-04a8-4476-94df-a590a624cc2e HTTP/1.1" status: 204 len: 168 time: 0.1645987 Nov 21 13:55:55.053994 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7956f63a-0f07-45a1-b19d-84919c08d408 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=144b6006-04a8-4476-94df-a590a624cc2e,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:55.077590 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47839d4a-3b80-4c80-ab98-4933dbcedee8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5f911346-962d-4333-9617-a611ad089d43,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:55.107165 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-47839d4a-3b80-4c80-ab98-4933dbcedee8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.108405 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-47839d4a-3b80-4c80-ab98-4933dbcedee8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4488959 Nov 21 13:55:55.111317 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55354) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:55.118131 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-066a33ca-e65b-4186-b68a-234105e288a0 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Request body: {'security_group_rule': {'security_group_id': '42126e3d-39be-4ee1-969d-6af11887f875', 'project_id': '406bef8592334a749f671da6881b0cf5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:55.150309 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.securitygroups_db [None req-066a33ca-e65b-4186-b68a-234105e288a0 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Project 406bef8592334a749f671da6881b0cf5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 21 13:55:55.156154 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-066a33ca-e65b-4186-b68a-234105e288a0 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.175230 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c615d89-2130-405e-ba3a-415233d5e210 req-b4c972d8-cdcf-4fc4-8411-1385cb4400c1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:55.176832 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1c615d89-2130-405e-ba3a-415233d5e210 req-b4c972d8-cdcf-4fc4-8411-1385cb4400c1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 947 time: 0.1598771 Nov 21 13:55:55.224250 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-066a33ca-e65b-4186-b68a-234105e288a0 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.230491 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.230956 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.231100 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-066a33ca-e65b-4186-b68a-234105e288a0 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.231333 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.l3_db [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Floating IP 5baecb0d-01e4-4ac3-967f-a8e540568d1f disassociated. External IP: 172.27.1.222, port: 627d561d-d2ff-449e-a99f-9e5e3fd874ba. Nov 21 13:55:55.231691 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling delete_port for 627d561d-d2ff-449e-a99f-9e5e3fd874ba owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:55:55.249628 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-066a33ca-e65b-4186-b68a-234105e288a0 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=607c5d29-e33e-4f2c-bf41-9d2b13eaf42c,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:55.264000 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1c615d89-2130-405e-ba3a-415233d5e210 req-0852c6ad-2a2c-45f5-bf84-38babaf496cc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=865776c3-79be-4d48-934d-4a1431a796df&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0745814 Nov 21 13:55:55.279624 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-066a33ca-e65b-4186-b68a-234105e288a0 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.286787 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-066a33ca-e65b-4186-b68a-234105e288a0 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1717727 Nov 21 13:55:55.289622 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55358) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:55.294900 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-8c0ac835-94df-4983-836b-84a63f460ff5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Request body: {'security_group_rule': {'security_group_id': '42126e3d-39be-4ee1-969d-6af11887f875', 'project_id': '406bef8592334a749f671da6881b0cf5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:55.323243 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.securitygroups_db [None req-8c0ac835-94df-4983-836b-84a63f460ff5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Project 406bef8592334a749f671da6881b0cf5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 21 13:55:55.329485 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8c0ac835-94df-4983-836b-84a63f460ff5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.331492 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-034a121a-ebb8-4c26-924c-b2fef4f863a1 None None] New status for floating IP e3393974-141a-4a0e-93e6-13bbaff6459b: ACTIVE {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 13:55:55.405907 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8c0ac835-94df-4983-836b-84a63f460ff5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.411779 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55360) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:55.412537 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8c0ac835-94df-4983-836b-84a63f460ff5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.431180 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c0ac835-94df-4983-836b-84a63f460ff5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=77ba1a0c-e428-4aef-a163-dfd583e8560e,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:55.435032 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-67fa5f9b-e5fe-4c71-8dba-704f97b36ef7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.441272 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8c0ac835-94df-4983-836b-84a63f460ff5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.442582 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-8c0ac835-94df-4983-836b-84a63f460ff5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1519039 Nov 21 13:55:55.484264 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.526909 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event deleted for resources: {'Port': ['ID=627d561d-d2ff-449e-a99f-9e5e3fd874ba,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:55.558733 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-57763e44-586e-4061-9c3e-6cfc0189f5a5 req-08c14395-0336-4376-8ed4-631bdf6b6796 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-858840109&fields=id&tenant_id=406bef8592334a749f671da6881b0cf5 HTTP/1.1" status: 200 len: 267 time: 0.0546653 Nov 21 13:55:55.620838 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57763e44-586e-4061-9c3e-6cfc0189f5a5 req-c3efe975-173c-4f04-90c0-72555a7d9838 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:55.622529 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-57763e44-586e-4061-9c3e-6cfc0189f5a5 req-c3efe975-173c-4f04-90c0-72555a7d9838 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 945 time: 0.0567050 Nov 21 13:55:55.635291 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [req-57763e44-586e-4061-9c3e-6cfc0189f5a5 req-ab8dee9a-5c2f-4759-b407-9f52cfc39a38 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Request body: {'port': {'security_groups': ['dcfd3018-6236-44ab-a1ee-abdf37bb89a5', '42126e3d-39be-4ee1-969d-6af11887f875']}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:55.702078 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-57763e44-586e-4061-9c3e-6cfc0189f5a5 req-ab8dee9a-5c2f-4759-b407-9f52cfc39a38 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.903158 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-67fa5f9b-e5fe-4c71-8dba-704f97b36ef7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.907972 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-67fa5f9b-e5fe-4c71-8dba-704f97b36ef7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:55.952524 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [req-57763e44-586e-4061-9c3e-6cfc0189f5a5 req-ab8dee9a-5c2f-4759-b407-9f52cfc39a38 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] For port 0f9a92e8-efd7-45cc-b13f-25658f0506ad, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=0f9a92e8-efd7-45cc-b13f-25658f0506ad,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:55:55.958139 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Router 0f049428-3827-4a0f-9254-57ee6dba40c0 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:55:55.958881 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67fa5f9b-e5fe-4c71-8dba-704f97b36ef7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8967609b-3205-4819-8ddd-3d5c7de3de06,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:55.965604 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-67fa5f9b-e5fe-4c71-8dba-704f97b36ef7 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=60c1fb8c85294f6b9e37707b98cbb0d6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5520642 Nov 21 13:55:55.968258 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55364) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:55.993746 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-57763e44-586e-4061-9c3e-6cfc0189f5a5 req-ab8dee9a-5c2f-4759-b407-9f52cfc39a38 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:56.000001 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-57763e44-586e-4061-9c3e-6cfc0189f5a5 req-ab8dee9a-5c2f-4759-b407-9f52cfc39a38 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2298230'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:56.014944 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['0f9a92e8-efd7-45cc-b13f-25658f0506ad'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:55:56.047032 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57763e44-586e-4061-9c3e-6cfc0189f5a5 req-ab8dee9a-5c2f-4759-b407-9f52cfc39a38 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:56.047658 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [req-57763e44-586e-4061-9c3e-6cfc0189f5a5 req-ab8dee9a-5c2f-4759-b407-9f52cfc39a38 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:56.049207 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-57763e44-586e-4061-9c3e-6cfc0189f5a5 req-ab8dee9a-5c2f-4759-b407-9f52cfc39a38 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "PUT /v2.0/ports/0f9a92e8-efd7-45cc-b13f-25658f0506ad HTTP/1.1" status: 200 len: 981 time: 0.4187684 Nov 21 13:55:56.050242 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad'}] {{(pid=109040) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:55:56.053133 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a0fb9e652e748194bc1d59d499050652e1260aa6f54aa3e041aed7364c74523c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832" -d '{"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]}' {{(pid=109040) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:55:56.077085 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab8dee9a-5c2f-4759-b407-9f52cfc39a38 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event updated for resources: {'Port': ['ID=0f9a92e8-efd7-45cc-b13f-25658f0506ad,revision_number=6']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:56.143838 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['0f9a92e8-efd7-45cc-b13f-25658f0506ad'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:55:56.156585 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:55:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-04f4b83c-b9b3-4c69-85d4-8852be6cc357 x-openstack-request-id: req-04f4b83c-b9b3-4c69-85d4-8852be6cc357 {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:55:56.156883 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad", "status": "completed", "code": 200}]} {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:55:56.157142 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-04f4b83c-b9b3-4c69-85d4-8852be6cc357 {{(pid=109040) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:55:56.157551 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad', 'status': 'completed', 'code': 200} Nov 21 13:55:56.169834 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:55:56.207573 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b1dc790-8bc7-4a25-969b-6fddedd5a97b None None] Sync routers for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:55:56.258400 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0aca4ab8-c17c-411f-9fb0-1859f7665148 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:56.279613 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] No DVR routers for this DVR port 627d561d-d2ff-449e-a99f-9e5e3fd874ba on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:55:56.283093 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:56.286837 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-739bf487-8e38-49c9-8f3a-c686221ea0cb req-a739fadb-be22-475a-9b93-d41262be20fe tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.50 "DELETE /v2.0/ports/627d561d-d2ff-449e-a99f-9e5e3fd874ba HTTP/1.1" status: 204 len: 173 time: 1.8642647 Nov 21 13:55:56.292987 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'name': 'network-vif-deleted', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:55:56.295331 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f866bca1-a794-4575-a198-a9186d091765" -d '{"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-deleted", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:55:56.318687 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b1dc790-8bc7-4a25-969b-6fddedd5a97b None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:55:56.319435 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8b1dc790-8bc7-4a25-969b-6fddedd5a97b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:55:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:56.330819 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2963af1f-c2b6-4dc4-a6d3-32ddd2def3c7 req-e068a444-a9a9-46d4-8b04-e464db1c5735 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:56.332381 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2963af1f-c2b6-4dc4-a6d3-32ddd2def3c7 req-e068a444-a9a9-46d4-8b04-e464db1c5735 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.1671150 Nov 21 13:55:56.345365 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0aca4ab8-c17c-411f-9fb0-1859f7665148 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:56.376026 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-ba72ed6a-cb39-4c85-abc7-5b3a14d7e41a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:56.377606 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-ba72ed6a-cb39-4c85-abc7-5b3a14d7e41a service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=406bef8592334a749f671da6881b0cf5&device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 1137 time: 0.1913958 Nov 21 13:55:56.442851 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-fe7b2ce1-d5aa-46ea-b401-2a5f92884ba9 req-d220ebf6-233b-45f4-bc63-f770f997c12b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=16e92c59-3be1-41c7-8ea1-b1bb65cf39c1 HTTP/1.1" status: 200 len: 210 time: 0.0468519 Nov 21 13:55:56.507416 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:55:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-efb0798f-15e1-4b13-80aa-bea8c0ece5ca x-openstack-request-id: req-efb0798f-15e1-4b13-80aa-bea8c0ece5ca {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:55:56.507722 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16e92c59-3be1-41c7-8ea1-b1bb65cf39c1", "name": "network-vif-deleted", "tag": "627d561d-d2ff-449e-a99f-9e5e3fd874ba", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:55:56.508024 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-efb0798f-15e1-4b13-80aa-bea8c0ece5ca {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:55:56.508393 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16e92c59-3be1-41c7-8ea1-b1bb65cf39c1', 'name': 'network-vif-deleted', 'tag': '627d561d-d2ff-449e-a99f-9e5e3fd874ba', 'status': 'completed', 'code': 200} Nov 21 13:55:56.522611 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2963af1f-c2b6-4dc4-a6d3-32ddd2def3c7 req-e18c896e-6fbc-40b8-a45c-69c2cd0add99 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1812012 Nov 21 13:55:56.541067 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0aca4ab8-c17c-411f-9fb0-1859f7665148 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:56.543990 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0aca4ab8-c17c-411f-9fb0-1859f7665148 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:56.547718 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-0aca4ab8-c17c-411f-9fb0-1859f7665148 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/8967609b-3205-4819-8ddd-3d5c7de3de06 HTTP/1.1" status: 204 len: 168 time: 0.5782609 Nov 21 13:55:56.567727 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aca4ab8-c17c-411f-9fb0-1859f7665148 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8967609b-3205-4819-8ddd-3d5c7de3de06,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:56.572753 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-daf5a730-266d-42d0-8105-0e5e04c80658 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:56.573018 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-702c6248-215e-4d80-808d-0fd791c66c32 None None] Provisioning complete for port 0f9a92e8-efd7-45cc-b13f-25658f0506ad triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:55:56.573895 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-702c6248-215e-4d80-808d-0fd791c66c32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:56.574255 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-daf5a730-266d-42d0-8105-0e5e04c80658 service neutron] 10.222.0.50 "GET /v2.0/networks?id=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 HTTP/1.1" status: 200 len: 915 time: 0.1820047 Nov 21 13:55:56.679791 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-8b1dc790-8bc7-4a25-969b-6fddedd5a97b None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:56.686221 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-f26a4cb9-feba-484c-a4ca-c7ba2e6cebd6 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0f9a92e8-efd7-45cc-b13f-25658f0506ad HTTP/1.1" status: 200 len: 1000 time: 0.0876169 Nov 21 13:55:56.746497 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-2a1c6a6c-4a37-4988-97aa-4752cb6433a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:56.748301 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-2a1c6a6c-4a37-4988-97aa-4752cb6433a5 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=7cdb43d5-ad8a-4fcf-8b29-113b86f21514 HTTP/1.1" status: 200 len: 853 time: 0.0517967 Nov 21 13:55:56.822843 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-3019339b-64bc-41c7-928b-cafff4cab315 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:56.826021 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-3019339b-64bc-41c7-928b-cafff4cab315 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0676148 Nov 21 13:55:57.013492 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-49fea27e-dc1e-40ff-958a-771b3024803d service neutron] 10.222.0.50 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1785274 Nov 21 13:55:57.139422 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-48bee2bb-b76d-41ae-b5a9-2d0f95a56832 req-db59628a-e45e-485d-ba75-067848f6cdef service neutron] 10.222.0.50 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1142423 Nov 21 13:55:57.214460 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8b1dc790-8bc7-4a25-969b-6fddedd5a97b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:59Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:57.247606 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b1dc790-8bc7-4a25-969b-6fddedd5a97b None None] Checking router: 0f049428-3827-4a0f-9254-57ee6dba40c0 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:55:57.271230 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b1dc790-8bc7-4a25-969b-6fddedd5a97b None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:55:57.271230 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8b1dc790-8bc7-4a25-969b-6fddedd5a97b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:55:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:57.405127 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-8b1dc790-8bc7-4a25-969b-6fddedd5a97b None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:55:57.562310 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55404) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:57.645670 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:57.648300 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-8b1dc790-8bc7-4a25-969b-6fddedd5a97b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:59Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:55:57.676130 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:57.685181 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b1dc790-8bc7-4a25-969b-6fddedd5a97b None None] The sync data for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi is: [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:59Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:55:57.732783 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:57.736514 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:57.738480 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "DELETE /v2.0/security-groups/865776c3-79be-4d48-934d-4a1431a796df HTTP/1.1" status: 204 len: 168 time: 0.1744153 Nov 21 13:55:57.741145 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55410) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:57.748955 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=865776c3-79be-4d48-934d-4a1431a796df,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:57.756922 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:57.757274 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:57.757621 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:57.757956 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:57.758292 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:57.758687 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:57.758992 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:57.759269 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:57.759595 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:57.759946 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:57.760080 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.api.v2.resource [None req-34491baa-c9c6-4a0d-ba18-5509c6e3eb3c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] show failed (client error): The resource could not be found. Nov 21 13:55:57.760284 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:57.760593 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ad332dc-927b-47dc-b1ae-42496f2a584f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:57.761040 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-34491baa-c9c6-4a0d-ba18-5509c6e3eb3c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups/865776c3-79be-4d48-934d-4a1431a796df HTTP/1.1" status: 404 len: 347 time: 0.0188949 Nov 21 13:55:57.764379 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55412) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:57.916743 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-bebaf64d-dd64-413c-9438-0022029e68b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Deleting port 08a8efe5-bdb0-4f2e-9dcb-b44c5671c48a {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:55:57.917172 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-bebaf64d-dd64-413c-9438-0022029e68b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.000752 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-bebaf64d-dd64-413c-9438-0022029e68b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.001029 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-bebaf64d-dd64-413c-9438-0022029e68b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.014616 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-bebaf64d-dd64-413c-9438-0022029e68b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling delete_port for 08a8efe5-bdb0-4f2e-9dcb-b44c5671c48a owned by network:floatingip {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:55:58.017429 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-982559c1-ca64-4868-adee-af19070ff1fa None None] New status for floating IP 5baecb0d-01e4-4ac3-967f-a8e540568d1f: DOWN {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 13:55:58.176199 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-bebaf64d-dd64-413c-9438-0022029e68b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.203596 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bebaf64d-dd64-413c-9438-0022029e68b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event deleted for resources: {'Port': ['ID=08a8efe5-bdb0-4f2e-9dcb-b44c5671c48a,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:58.277819 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-bebaf64d-dd64-413c-9438-0022029e68b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.280753 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-bebaf64d-dd64-413c-9438-0022029e68b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.283667 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-bebaf64d-dd64-413c-9438-0022029e68b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "DELETE /v2.0/floatingips/5baecb0d-01e4-4ac3-967f-a8e540568d1f HTTP/1.1" status: 204 len: 168 time: 0.5168166 Nov 21 13:55:58.301353 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 627d561d-d2ff-449e-a99f-9e5e3fd874ba no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:55:58.337004 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: 627d561d-d2ff-449e-a99f-9e5e3fd874ba {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:55:58.337363 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 627d561d-d2ff-449e-a99f-9e5e3fd874ba not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:55:58.520249 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55438) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:58.525127 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-ace62d1c-43a2-4b86-a217-738467784d04 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1011287868', 'description': 'tempest-description--983010310'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:58.546498 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ace62d1c-43a2-4b86-a217-738467784d04 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.613989 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ace62d1c-43a2-4b86-a217-738467784d04 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.618176 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ace62d1c-43a2-4b86-a217-738467784d04 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.648431 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ace62d1c-43a2-4b86-a217-738467784d04 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8c3a1f04-58b3-451a-8948-b2f8f099915c,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:58.652643 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ace62d1c-43a2-4b86-a217-738467784d04 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.656459 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-ace62d1c-43a2-4b86-a217-738467784d04 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1324198 Nov 21 13:55:58.657018 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55440) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:58.664804 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Request body: {'security_group_rule': {'security_group_id': '8c3a1f04-58b3-451a-8948-b2f8f099915c', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:58.694973 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.751775 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.756757 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.777499 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=96aa5b00-da9b-4ea8-85b2-5e8613c66fe2,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:58.786675 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.787866 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1297755 Nov 21 13:55:58.789291 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:58.789639 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:58.789993 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:58.790326 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:58.790638 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55446) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:58.790748 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:58.790983 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:58.791315 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:58.791646 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:58.792045 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:58.792336 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:58.792721 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:58.792983 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397a86b-0207-416d-840f-e5e7e68d70af tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:55:58.795516 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-e0bd7ddf-2bfa-4e20-a9e3-feae4225100d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Request body: {'security_group_rule': {'security_group_id': '8c3a1f04-58b3-451a-8948-b2f8f099915c', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:58.826916 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-e0bd7ddf-2bfa-4e20-a9e3-feae4225100d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.881803 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-e0bd7ddf-2bfa-4e20-a9e3-feae4225100d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.885356 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-e0bd7ddf-2bfa-4e20-a9e3-feae4225100d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.902125 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0bd7ddf-2bfa-4e20-a9e3-feae4225100d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=805d818d-ba62-429d-8542-abe79e9f52f0,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:58.909953 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-e0bd7ddf-2bfa-4e20-a9e3-feae4225100d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:58.911136 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-e0bd7ddf-2bfa-4e20-a9e3-feae4225100d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1194499 Nov 21 13:55:58.914176 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55448) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:55:58.918346 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Request body: {'floatingip': {'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:55:58.939361 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:59.034675 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:59.137525 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Allocated IP 172.27.1.178 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/a94eabff-a869-4427-92e5-18a7a87285f6) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:55:59.236538 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:59.270370 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:59.307988 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:55:59.310788 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:55:59.314328 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:55:59.338234 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event updated for resources: {'Port': ['ID=a94eabff-a869-4427-92e5-18a7a87285f6,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:59.404019 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:59.436670 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:59.579820 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:59.584017 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:59.646057 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event updated for resources: {'Port': ['ID=a94eabff-a869-4427-92e5-18a7a87285f6,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:55:59.659296 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:59.673702 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:55:59.675470 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-ccf48f3c-efee-45b3-9c0c-667c7fa87dfd tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.7603869 Nov 21 13:55:59.871161 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-78a68e48-f4f4-4056-bad3-bd3c7d8fc201 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-securitygroup--1011287868&fields=id&tenant_id=3d25ecbdc2ba435488271022d897a406 HTTP/1.1" status: 200 len: 267 time: 0.0449343 Nov 21 13:55:59.987546 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-752de3fb-584a-4189-a1a9-6b07b3cdb15d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:55:59.989040 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-752de3fb-584a-4189-a1a9-6b07b3cdb15d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/networks?id=24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 200 len: 817 time: 0.1107843 Nov 21 13:56:00.003865 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ee6b5c8c-2429-40e8-b659-d827bc0d00c8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/quotas/3d25ecbdc2ba435488271022d897a406 HTTP/1.1" status: 200 len: 375 time: 0.0089903 Nov 21 13:56:00.054146 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-11f942ce-66c4-41c7-b4c3-87e49b9d53ee tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0451751 Nov 21 13:56:00.157689 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-43d757c3-b925-484e-ac76-8285545d8b03 service neutron] 10.222.0.11 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0917215 Nov 21 13:56:00.167944 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6da761d9-92d8-48d9-b037-58ce8875c0f1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:00.248367 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ed2bce0f-3d02-4dc2-aeea-8276e8dc3bd4 service neutron] 10.222.0.11 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830545 Nov 21 13:56:00.401697 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-185b8898-d4c0-490a-99ee-4b66829708a8 req-efc20f3f-0d79-445c-b2dd-650c04a2fa38 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 210 time: 0.0264416 Nov 21 13:56:01.211649 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55490) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:01.365995 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bc69321-a315-490c-88f8-35b5fb558b46 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:01.450759 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-a5e1783e-fb8f-4868-bf8d-4d3fb812477f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:01.452240 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-a5e1783e-fb8f-4868-bf8d-4d3fb812477f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.50 "GET /v2.0/networks?id=24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 200 len: 817 time: 0.1473641 Nov 21 13:56:01.531246 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3e063415-c0cb-4aac-876c-3266a16cf491 req-adb4528d-133c-4ea7-b16e-cdc6ac85a638 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 210 time: 0.0504515 Nov 21 13:56:01.540184 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bc69321-a315-490c-88f8-35b5fb558b46 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:01.548121 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5bc69321-a315-490c-88f8-35b5fb558b46 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:01.590662 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ba402882-8a5e-41e7-acc3-f93ee342ce99 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.50 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3d25ecbdc2ba435488271022d897a406 HTTP/1.1" status: 200 len: 380 time: 0.1251972 Nov 21 13:56:01.601414 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-5bc69321-a315-490c-88f8-35b5fb558b46 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=0b4827dc6c104fd08ec75e115266bcf4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3886356 Nov 21 13:56:01.604406 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55502) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:01.605126 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ab6b8cdd-2dca-4ba0-8cf2-b9faa707a947 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Request body: {'port': {'device_id': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'admin_state_up': True, 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'security_groups': ['8c3a1f04-58b3-451a-8948-b2f8f099915c']}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:01.608050 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bc69321-a315-490c-88f8-35b5fb558b46 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4117c47a-539a-4687-af25-ad2e2bb9d16b,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:01.651786 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b704a518-3f87-430c-8e15-5a16222e781f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:01.673305 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b704a518-3f87-430c-8e15-5a16222e781f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:01.712984 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ab6b8cdd-2dca-4ba0-8cf2-b9faa707a947 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Made reservation on behalf of 3d25ecbdc2ba435488271022d897a406 for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:56:01.716645 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ab6b8cdd-2dca-4ba0-8cf2-b9faa707a947 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:01.719258 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b704a518-3f87-430c-8e15-5a16222e781f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:01.721892 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b704a518-3f87-430c-8e15-5a16222e781f admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:01.725523 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-b704a518-3f87-430c-8e15-5a16222e781f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/4117c47a-539a-4687-af25-ad2e2bb9d16b HTTP/1.1" status: 204 len: 168 time: 0.1176376 Nov 21 13:56:01.732176 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b704a518-3f87-430c-8e15-5a16222e781f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4117c47a-539a-4687-af25-ad2e2bb9d16b,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:01.849771 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ab6b8cdd-2dca-4ba0-8cf2-b9faa707a947 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Allocated IP 172.20.0.3 (24c864ef-5c5a-4df8-8968-78a7fe30b188/c4887ea6-9c0e-4a7b-bd51-d70b335ceb92/73851145-2483-4c28-bf3b-f049e97c28cc) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:56:01.991297 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ab6b8cdd-2dca-4ba0-8cf2-b9faa707a947 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:01.999993 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55508) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:02.013880 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c327ce80-70ca-4964-979e-4a92f8898393 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.026224 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ab6b8cdd-2dca-4ba0-8cf2-b9faa707a947 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.070306 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ab6b8cdd-2dca-4ba0-8cf2-b9faa707a947 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Network 24c864ef-5c5a-4df8-8968-78a7fe30b188 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:56:02.073429 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ab6b8cdd-2dca-4ba0-8cf2-b9faa707a947 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:56:02.077022 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ab6b8cdd-2dca-4ba0-8cf2-b9faa707a947 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:56:02.089592 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c327ce80-70ca-4964-979e-4a92f8898393 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.094732 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c327ce80-70ca-4964-979e-4a92f8898393 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.100839 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab6b8cdd-2dca-4ba0-8cf2-b9faa707a947 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event updated for resources: {'Port': ['ID=73851145-2483-4c28-bf3b-f049e97c28cc,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:02.130452 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ab6b8cdd-2dca-4ba0-8cf2-b9faa707a947 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:02.131365 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ab6b8cdd-2dca-4ba0-8cf2-b9faa707a947 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.144394 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-c327ce80-70ca-4964-979e-4a92f8898393 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=bd2e82860a6f44febb83d77a447c15eb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1428788 Nov 21 13:56:02.145493 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c327ce80-70ca-4964-979e-4a92f8898393 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce926bda-612c-42f8-b44a-27e35f28f353,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:02.147576 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55512) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:02.153172 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-ab6b8cdd-2dca-4ba0-8cf2-b9faa707a947 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5543916 Nov 21 13:56:02.169331 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Request body: {'port': {'device_id': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:02.256903 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b332817-1f58-4aa8-9ff8-4502720fe8f7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.258447 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.308696 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b332817-1f58-4aa8-9ff8-4502720fe8f7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.354660 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-605292ac-1f6b-4424-a008-fcc3f67e6234 None None] Provisioning complete for port 73851145-2483-4c28-bf3b-f049e97c28cc triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:56:02.355229 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-605292ac-1f6b-4424-a008-fcc3f67e6234 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.389652 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-605292ac-1f6b-4424-a008-fcc3f67e6234 None None] Port 73851145-2483-4c28-bf3b-f049e97c28cc cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:56:02.426161 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b332817-1f58-4aa8-9ff8-4502720fe8f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.428714 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5b332817-1f58-4aa8-9ff8-4502720fe8f7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.429845 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-5b332817-1f58-4aa8-9ff8-4502720fe8f7 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ce926bda-612c-42f8-b44a-27e35f28f353 HTTP/1.1" status: 204 len: 168 time: 0.2812331 Nov 21 13:56:02.469733 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b332817-1f58-4aa8-9ff8-4502720fe8f7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce926bda-612c-42f8-b44a-27e35f28f353,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:02.568592 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-157af503-524c-4a55-a99b-880f6fe21ed9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.577341 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 73851145-2483-4c28-bf3b-f049e97c28cc {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:56:02.585726 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.598866 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Transition to ACTIVE for port object 73851145-2483-4c28-bf3b-f049e97c28cc will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:56:02.603042 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.615145 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:56:02.656074 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Pushing event updated for resources: {'Port': ['ID=73851145-2483-4c28-bf3b-f049e97c28cc,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:02.686679 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55d6c70f-14d6-422d-a3b9-989c9f303730 req-75d14108-c7c3-46b5-9e2c-fcabfc71ad37 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:02.689154 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-55d6c70f-14d6-422d-a3b9-989c9f303730 req-75d14108-c7c3-46b5-9e2c-fcabfc71ad37 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0718534 Nov 21 13:56:02.738378 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Attempting to bind port 73851145-2483-4c28-bf3b-f049e97c28cc on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:56:02.738735 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Attempting to bind port 73851145-2483-4c28-bf3b-f049e97c28cc by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:56:02.739072 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Attempting to bind port 73851145-2483-4c28-bf3b-f049e97c28cc on network 24c864ef-5c5a-4df8-8968-78a7fe30b188 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:56:02.750332 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Port 73851145-2483-4c28-bf3b-f049e97c28cc on network 24c864ef-5c5a-4df8-8968-78a7fe30b188 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:56:02.751467 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Attempting to bind port 73851145-2483-4c28-bf3b-f049e97c28cc on network 24c864ef-5c5a-4df8-8968-78a7fe30b188 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:56:02.756966 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 55, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:56:02.757977 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Checking segment: {'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:56:02.758220 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-55d6c70f-14d6-422d-a3b9-989c9f303730 req-7a2497dc-208d-4381-bb90-b41c519286b3 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0601542 Nov 21 13:56:02.758745 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Bound using segment: {'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:56:02.759247 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Bound port: 73851145-2483-4c28-bf3b-f049e97c28cc, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1366d621-cbe7-4737-8733-1d29712acbd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:56:02.759671 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.841048 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] For port 73851145-2483-4c28-bf3b-f049e97c28cc, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:56:02.844411 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] For port 73851145-2483-4c28-bf3b-f049e97c28cc, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=73851145-2483-4c28-bf3b-f049e97c28cc,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:56:02.849503 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.884804 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:02.885447 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:02.886821 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] 10.222.0.50 "PUT /v2.0/ports/73851145-2483-4c28-bf3b-f049e97c28cc HTTP/1.1" status: 200 len: 1093 time: 0.7215769 Nov 21 13:56:02.887354 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:02.889592 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b6c7f754-02c6-4f60-8a88-e7854a060f03" -d '{"events": [{"name": "network-changed", "server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:02.917513 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5260139-7745-4bc2-9f75-fea339aa24b2 service neutron] Pushing event updated for resources: {'Port': ['ID=73851145-2483-4c28-bf3b-f049e97c28cc,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:02.935712 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-75dbce19-5b90-48a5-aee2-cdee6964e5c5 x-openstack-request-id: req-75dbce19-5b90-48a5-aee2-cdee6964e5c5 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:02.936279 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:02.936701 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-75dbce19-5b90-48a5-aee2-cdee6964e5c5 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:02.937354 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc', 'status': 'completed', 'code': 200} Nov 21 13:56:02.989864 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-be97045c-21d8-49f0-990d-d97367c32ddf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:02.992216 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-be97045c-21d8-49f0-990d-d97367c32ddf service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 1096 time: 0.0468957 Nov 21 13:56:03.045948 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-a523e1a3-87db-4c15-88af-f91821911dbb service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=73851145-2483-4c28-bf3b-f049e97c28cc HTTP/1.1" status: 200 len: 217 time: 0.0442159 Nov 21 13:56:03.097873 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-cf1d4f3c-ec0e-45dd-b2f2-9e17ec71d776 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:03.099349 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-cf1d4f3c-ec0e-45dd-b2f2-9e17ec71d776 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=c4887ea6-9c0e-4a7b-bd51-d70b335ceb92 HTTP/1.1" status: 200 len: 856 time: 0.0458102 Nov 21 13:56:03.148773 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-079cfe43-ec56-4a42-b38d-e70df7696b68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:03.150279 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-079cfe43-ec56-4a42-b38d-e70df7696b68 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=24c864ef-5c5a-4df8-8968-78a7fe30b188&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0423903 Nov 21 13:56:03.243753 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-10e775e3-f784-4268-bdf5-3138d072b090 service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857363 Nov 21 13:56:03.337131 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-227f7a51-aa5c-4603-a8d1-2050f493e42c req-a42144e8-191a-4107-815c-b58a346ce336 service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831354 Nov 21 13:56:03.425433 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-a5b7a55d-658d-494b-aa1d-734dd7f82870 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:03.427019 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-a5b7a55d-658d-494b-aa1d-734dd7f82870 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 1096 time: 0.0415833 Nov 21 13:56:03.522181 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-138eb40f-1e4a-45a6-8ffc-03c755bc6920 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:03.523686 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-138eb40f-1e4a-45a6-8ffc-03c755bc6920 service neutron] 10.222.0.50 "GET /v2.0/networks?id=24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 200 len: 918 time: 0.0887370 Nov 21 13:56:03.572385 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-8ad3869e-057a-4ad2-a47a-4f2e518ee920 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=73851145-2483-4c28-bf3b-f049e97c28cc HTTP/1.1" status: 200 len: 217 time: 0.0392168 Nov 21 13:56:03.626519 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-d2413d35-601f-4ad4-9c8f-e3528ecf082d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:03.628834 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-d2413d35-601f-4ad4-9c8f-e3528ecf082d service neutron] 10.222.0.50 "GET /v2.0/subnets?id=c4887ea6-9c0e-4a7b-bd51-d70b335ceb92 HTTP/1.1" status: 200 len: 856 time: 0.0474758 Nov 21 13:56:03.674671 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-275f7dc4-7ce2-4373-92af-3e8c712dabf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:03.676159 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-275f7dc4-7ce2-4373-92af-3e8c712dabf4 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=24c864ef-5c5a-4df8-8968-78a7fe30b188&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0394793 Nov 21 13:56:03.764573 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-083b891c-f737-463c-957d-d5bb2b74853b service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0805585 Nov 21 13:56:03.885100 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:03.899318 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b968e2f-756a-4a06-8a95-d71ae0dc8875 req-bd1805ca-778c-48f5-96f7-2cf0661651e5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:03.900914 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4b968e2f-756a-4a06-8a95-d71ae0dc8875 req-bd1805ca-778c-48f5-96f7-2cf0661651e5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0620823 Nov 21 13:56:03.953470 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4b968e2f-756a-4a06-8a95-d71ae0dc8875 req-bbe13569-b097-4154-ad00-946aa78bb6b0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456951 Nov 21 13:56:04.121055 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b6c7f754-02c6-4f60-8a88-e7854a060f03 req-168540e0-3b99-4c3e-8fd1-989483fe740d service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3480456 Nov 21 13:56:05.063373 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:05.077073 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7247c5-4a84-405f-9b12-7b51a3d0efbe req-ae72916c-08cf-45ce-b1a7-7da84a02fa65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:05.078513 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a7247c5-4a84-405f-9b12-7b51a3d0efbe req-ae72916c-08cf-45ce-b1a7-7da84a02fa65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0500453 Nov 21 13:56:05.129090 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a7247c5-4a84-405f-9b12-7b51a3d0efbe req-16b0fed2-b914-4e42-ab02-64a22aba94d9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437772 Nov 21 13:56:05.847788 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:06.248178 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0530094-c1a1-4260-bd2a-bd5cef184924 req-c515f495-0306-45f6-b7c2-6bc973d30141 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:06.249665 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b0530094-c1a1-4260-bd2a-bd5cef184924 req-c515f495-0306-45f6-b7c2-6bc973d30141 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0508807 Nov 21 13:56:06.296296 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b0530094-c1a1-4260-bd2a-bd5cef184924 req-e61eba90-853c-4f8f-9c5b-280c140a2e8d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404189 Nov 21 13:56:06.677054 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 73851145-2483-4c28-bf3b-f049e97c28cc details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:56:06.768304 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 73851145-2483-4c28-bf3b-f049e97c28cc, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=73851145-2483-4c28-bf3b-f049e97c28cc,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:06.779519 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '73851145-2483-4c28-bf3b-f049e97c28cc', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'port_id': '73851145-2483-4c28-bf3b-f049e97c28cc', 'mac_address': 'fa:16:3e:e1:6b:20', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 524, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:56:06.815694 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:06.831698 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 73851145-2483-4c28-bf3b-f049e97c28cc {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:56:06.850790 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 73851145-2483-4c28-bf3b-f049e97c28cc, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=73851145-2483-4c28-bf3b-f049e97c28cc,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:06.854674 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:07.013478 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=73851145-2483-4c28-bf3b-f049e97c28cc,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:07.415022 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1893ea84-23ef-488b-92f0-9fcc0cbf9ff5 req-34159057-e0f7-436a-acee-a5cd96b33a7a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:07.416484 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1893ea84-23ef-488b-92f0-9fcc0cbf9ff5 req-34159057-e0f7-436a-acee-a5cd96b33a7a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 944 time: 0.0507305 Nov 21 13:56:07.464459 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1893ea84-23ef-488b-92f0-9fcc0cbf9ff5 req-a4508f66-5022-42e6-a680-af018e6faad4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415912 Nov 21 13:56:08.580274 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4afeeaf8-6d04-49b8-9814-b02b7292f9d2 req-2987ed42-9b98-4daf-8fe7-3ef564f04fd7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:08.581706 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4afeeaf8-6d04-49b8-9814-b02b7292f9d2 req-2987ed42-9b98-4daf-8fe7-3ef564f04fd7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 944 time: 0.0487688 Nov 21 13:56:08.628004 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4afeeaf8-6d04-49b8-9814-b02b7292f9d2 req-a4c92c6e-87d6-4fcb-81f9-2655215bbd3c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404785 Nov 21 13:56:08.836577 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['73851145-2483-4c28-bf3b-f049e97c28cc'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:56:09.746591 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbea4048-c325-4ee9-ae6a-4d4fb13a62bb req-0a3830e2-d1d9-4971-a50b-3993c5b2b2da tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:09.748075 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bbea4048-c325-4ee9-ae6a-4d4fb13a62bb req-0a3830e2-d1d9-4971-a50b-3993c5b2b2da tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 944 time: 0.0484767 Nov 21 13:56:09.794989 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bbea4048-c325-4ee9-ae6a-4d4fb13a62bb req-874b6c12-39a7-4cdb-a329-ef1e7dd559de tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397062 Nov 21 13:56:10.506121 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 73851145-2483-4c28-bf3b-f049e97c28cc up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:56:10.552509 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port 73851145-2483-4c28-bf3b-f049e97c28cc completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:56:10.556414 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 73851145-2483-4c28-bf3b-f049e97c28cc triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:56:10.556781 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:10.631082 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:10.658971 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:10.661224 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d1bf376c-eaa8-46f4-aa9e-ed2cdaa7129b" -d '{"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-plugged", "status": "completed", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:10.673526 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 73851145-2483-4c28-bf3b-f049e97c28cc, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=73851145-2483-4c28-bf3b-f049e97c28cc,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:10.678081 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:10.700371 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e9de45a-f304-42ae-a503-4955aeb6bc81 x-openstack-request-id: req-0e9de45a-f304-42ae-a503-4955aeb6bc81 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:10.700695 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-plugged", "status": "completed", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:10.700958 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-0e9de45a-f304-42ae-a503-4955aeb6bc81 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:10.701351 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc', 'code': 200} Nov 21 13:56:10.726969 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=73851145-2483-4c28-bf3b-f049e97c28cc,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:10.901185 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ba267a1-7ba7-4647-9e24-8ad53e6b1f5d req-7affd022-c78d-4e1c-9d8b-6a0af02d37d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:10.902571 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5ba267a1-7ba7-4647-9e24-8ad53e6b1f5d req-7affd022-c78d-4e1c-9d8b-6a0af02d37d0 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 1098 time: 0.0648465 Nov 21 13:56:10.935892 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d836e83-20d7-4674-9108-085b6d5560c6 req-c2655241-b5e1-405f-b785-aaebc9f332e9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:10.937283 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4d836e83-20d7-4674-9108-085b6d5560c6 req-c2655241-b5e1-405f-b785-aaebc9f332e9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0688059 Nov 21 13:56:10.972519 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5ba267a1-7ba7-4647-9e24-8ad53e6b1f5d req-c8e46e93-8406-4f3d-9d73-e3bc87be1984 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0600700 Nov 21 13:56:10.998763 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4d836e83-20d7-4674-9108-085b6d5560c6 req-f7e48a36-0333-4af0-a6a3-e3b12d412e17 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0523109 Nov 21 13:56:12.118103 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0104156e-99f9-475a-8cac-f5ef6d5f8d8d req-f35c7595-e1e4-40b0-98d7-fae9606c4c51 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:12.119610 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0104156e-99f9-475a-8cac-f5ef6d5f8d8d req-f35c7595-e1e4-40b0-98d7-fae9606c4c51 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0477381 Nov 21 13:56:12.170635 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0104156e-99f9-475a-8cac-f5ef6d5f8d8d req-c3c607fa-b50f-493e-bbdf-2fdd474fd96e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448291 Nov 21 13:56:12.517584 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55630) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:12.617762 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-945e2989-f0b0-4917-9ad3-ce6a530253cd admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:12.689607 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-945e2989-f0b0-4917-9ad3-ce6a530253cd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:12.693095 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-945e2989-f0b0-4917-9ad3-ce6a530253cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:12.733944 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-945e2989-f0b0-4917-9ad3-ce6a530253cd admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=c4caa396e97e4fab9ba2eee974e0d285&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2147911 Nov 21 13:56:12.735160 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-945e2989-f0b0-4917-9ad3-ce6a530253cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=989cebe7-18f7-4324-90a6-ea704c2eae4e,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:12.737089 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55634) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:12.787738 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3d54b71b-3f03-42e7-af9d-bd35d0bbabf9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:12.807829 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3d54b71b-3f03-42e7-af9d-bd35d0bbabf9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:12.856263 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3d54b71b-3f03-42e7-af9d-bd35d0bbabf9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:12.858809 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-3d54b71b-3f03-42e7-af9d-bd35d0bbabf9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:12.859970 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-3d54b71b-3f03-42e7-af9d-bd35d0bbabf9 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/989cebe7-18f7-4324-90a6-ea704c2eae4e HTTP/1.1" status: 204 len: 168 time: 0.1216972 Nov 21 13:56:12.867354 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d54b71b-3f03-42e7-af9d-bd35d0bbabf9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=989cebe7-18f7-4324-90a6-ea704c2eae4e,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:13.117446 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55640) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:13.134627 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8f2b40dd-e42a-476b-b455-99a07f7706c1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:13.205929 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8f2b40dd-e42a-476b-b455-99a07f7706c1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:13.209635 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8f2b40dd-e42a-476b-b455-99a07f7706c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:13.247240 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-8f2b40dd-e42a-476b-b455-99a07f7706c1 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=ddc3fa9f01d54b4fa42ef8586dbb5afd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1287091 Nov 21 13:56:13.248102 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f2b40dd-e42a-476b-b455-99a07f7706c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ad4a37d-8269-42a2-8298-308a64569a90,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:13.250553 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55644) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:13.304297 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-a3663cb8-6eaa-482e-b3a0-5da3f7602716 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:13.305750 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3757bc-4345-4645-af21-8712ee17470f req-a507762b-96e8-4826-96ed-6810fe41936d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:13.307309 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2e3757bc-4345-4645-af21-8712ee17470f req-a507762b-96e8-4826-96ed-6810fe41936d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0653052 Nov 21 13:56:13.326186 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-a3663cb8-6eaa-482e-b3a0-5da3f7602716 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:13.366410 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2e3757bc-4345-4645-af21-8712ee17470f req-135e7fe5-392b-442d-8f63-db3352abb419 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0530224 Nov 21 13:56:13.374047 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-a3663cb8-6eaa-482e-b3a0-5da3f7602716 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:13.377815 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-a3663cb8-6eaa-482e-b3a0-5da3f7602716 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:13.381367 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-a3663cb8-6eaa-482e-b3a0-5da3f7602716 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/4ad4a37d-8269-42a2-8298-308a64569a90 HTTP/1.1" status: 204 len: 168 time: 0.1275167 Nov 21 13:56:13.388853 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3663cb8-6eaa-482e-b3a0-5da3f7602716 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ad4a37d-8269-42a2-8298-308a64569a90,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:13.494039 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c7444c3-905e-4b33-9456-530b950985ee req-bc74dc28-16f7-4acb-befb-5c3b515ec87d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:13.495762 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8c7444c3-905e-4b33-9456-530b950985ee req-bc74dc28-16f7-4acb-befb-5c3b515ec87d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0519149 Nov 21 13:56:13.505192 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55658) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:13.509714 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-cecf58f4-b463-4444-b48f-47c1f9919c86 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Request body: {'floatingip': {'port_id': '73851145-2483-4c28-bf3b-f049e97c28cc'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:13.549482 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cecf58f4-b463-4444-b48f-47c1f9919c86 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:13.713183 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57721c23-633f-4839-965e-eb5b6b8bb1e7 req-1e94316c-775a-4db4-801b-bd7b9a6db94b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:13.714681 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-57721c23-633f-4839-965e-eb5b6b8bb1e7 req-1e94316c-775a-4db4-801b-bd7b9a6db94b tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0487802 Nov 21 13:56:13.771997 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-57721c23-633f-4839-965e-eb5b6b8bb1e7 req-d44e4fed-ccf5-4a21-bc02-d54a9b038594 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0501781 Nov 21 13:56:13.994081 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cecf58f4-b463-4444-b48f-47c1f9919c86 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:13.998615 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cecf58f4-b463-4444-b48f-47c1f9919c86 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:14.098310 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.l3_db [None req-cecf58f4-b463-4444-b48f-47c1f9919c86 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Floating IP df220ba1-ef93-4c8b-a2f7-65a74fda1ae6 associated. External IP: 172.27.1.178, port: 73851145-2483-4c28-bf3b-f049e97c28cc. Nov 21 13:56:14.308236 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cecf58f4-b463-4444-b48f-47c1f9919c86 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Router 0f049428-3827-4a0f-9254-57ee6dba40c0 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:56:14.462542 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55688) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:14.573894 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f3057c4c-c4b6-400b-b09b-2dff712f4fa8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:14.631499 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cecf58f4-b463-4444-b48f-47c1f9919c86 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:56:14.636387 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cecf58f4-b463-4444-b48f-47c1f9919c86 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:14.641814 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f86eca59-fcb3-4d62-8a2f-375ee77f011b None None] Sync routers for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:56:14.652102 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f3057c4c-c4b6-400b-b09b-2dff712f4fa8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:14.652648 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f86eca59-fcb3-4d62-8a2f-375ee77f011b None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:56:14.653305 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-f86eca59-fcb3-4d62-8a2f-375ee77f011b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:56:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:56:14.657485 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f3057c4c-c4b6-400b-b09b-2dff712f4fa8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:14.667495 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-cecf58f4-b463-4444-b48f-47c1f9919c86 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "PUT /v2.0/floatingips/df220ba1-ef93-4c8b-a2f7-65a74fda1ae6 HTTP/1.1" status: 200 len: 991 time: 1.1587136 Nov 21 13:56:14.667495 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc'}] {{(pid=109040) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:14.667786 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a0fb9e652e748194bc1d59d499050652e1260aa6f54aa3e041aed7364c74523c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4113c229-0f39-4f30-bcc1-87eb292f41ba" -d '{"events": [{"name": "network-changed", "server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]}' {{(pid=109040) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:14.684081 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55696) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:14.684215 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-f3057c4c-c4b6-400b-b09b-2dff712f4fa8 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=77add230529442c3a12043e87f7d567d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2204218 Nov 21 13:56:14.704083 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3057c4c-c4b6-400b-b09b-2dff712f4fa8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=069a4bd9-53c4-438f-ba3f-65e4291e1771,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:14.738986 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8dfa5f0-02c5-4ff1-a110-31fe53284f6b x-openstack-request-id: req-a8dfa5f0-02c5-4ff1-a110-31fe53284f6b {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:14.739578 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc", "status": "completed", "code": 200}]} {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:14.740190 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-a8dfa5f0-02c5-4ff1-a110-31fe53284f6b {{(pid=109040) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:14.740313 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc', 'status': 'completed', 'code': 200} Nov 21 13:56:14.745143 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4a942e06-d84d-49b4-baa6-22afecd9feaa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:14.776572 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4a942e06-d84d-49b4-baa6-22afecd9feaa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:14.779178 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-f86eca59-fcb3-4d62-8a2f-375ee77f011b None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:56:14.795556 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-effada7c-bb7c-4883-96d3-c586cecab5c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:14.797794 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-effada7c-bb7c-4883-96d3-c586cecab5c3 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 1098 time: 0.0442522 Nov 21 13:56:14.853220 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4a942e06-d84d-49b4-baa6-22afecd9feaa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:14.856417 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4a942e06-d84d-49b4-baa6-22afecd9feaa admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:14.859978 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-4a942e06-d84d-49b4-baa6-22afecd9feaa admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/069a4bd9-53c4-438f-ba3f-65e4291e1771 HTTP/1.1" status: 204 len: 168 time: 0.1710761 Nov 21 13:56:14.865900 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a942e06-d84d-49b4-baa6-22afecd9feaa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=069a4bd9-53c4-438f-ba3f-65e4291e1771,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:14.950899 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fb63c3-4871-48c1-913c-a58ec953d826 req-2c40dc38-2fe0-4552-b16c-79a5b74b33bd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:14.952466 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e7fb63c3-4871-48c1-913c-a58ec953d826 req-2c40dc38-2fe0-4552-b16c-79a5b74b33bd tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.1015098 Nov 21 13:56:14.990169 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-3a763a64-e295-48b2-9f61-3660a8a7737a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:14.991711 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-3a763a64-e295-48b2-9f61-3660a8a7737a service neutron] 10.222.0.50 "GET /v2.0/networks?id=24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 200 len: 918 time: 0.1749525 Nov 21 13:56:15.042371 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-f86eca59-fcb3-4d62-8a2f-375ee77f011b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'df220ba1-ef93-4c8b-a2f7-65a74fda1ae6', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'floating_ip_address': '172.27.1.178', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'port_id': '73851145-2483-4c28-bf3b-f049e97c28cc', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'mac_address': 'fa:16:3e:e1:6b:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:55:59Z', 'updated_at': '2021-11-21T13:56:13Z', 'revision_number': 1, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:59Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:56:15.070318 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f86eca59-fcb3-4d62-8a2f-375ee77f011b None None] Checking router: 0f049428-3827-4a0f-9254-57ee6dba40c0 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:56:15.072297 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-655577da-cb65-4d63-ad31-8948c048437d service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=73851145-2483-4c28-bf3b-f049e97c28cc HTTP/1.1" status: 200 len: 999 time: 0.0701466 Nov 21 13:56:15.079710 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f86eca59-fcb3-4d62-8a2f-375ee77f011b None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:56:15.079869 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e7fb63c3-4871-48c1-913c-a58ec953d826 req-feb06d3e-6d4c-4e97-a4cd-e05e6b2ebc7d tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1185496 Nov 21 13:56:15.080425 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-f86eca59-fcb3-4d62-8a2f-375ee77f011b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:56:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:56:15.139032 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-a923d98c-5fe7-41ae-91be-c31fe01e8f54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:15.140530 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-a923d98c-5fe7-41ae-91be-c31fe01e8f54 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=c4887ea6-9c0e-4a7b-bd51-d70b335ceb92 HTTP/1.1" status: 200 len: 856 time: 0.0549386 Nov 21 13:56:15.188670 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-a3701c63-d427-4fd4-affd-2512a1973815 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:15.190255 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-a3701c63-d427-4fd4-affd-2512a1973815 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=24c864ef-5c5a-4df8-8968-78a7fe30b188&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0417547 Nov 21 13:56:15.205438 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-f86eca59-fcb3-4d62-8a2f-375ee77f011b None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:56:15.290781 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-c5b1d47e-cc25-4017-84dd-da20e9fd5b0f service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0926535 Nov 21 13:56:15.401901 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4113c229-0f39-4f30-bcc1-87eb292f41ba req-de96f0b5-857a-461f-9cf5-d5a4c81e2527 service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0979047 Nov 21 13:56:15.447176 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-f86eca59-fcb3-4d62-8a2f-375ee77f011b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'df220ba1-ef93-4c8b-a2f7-65a74fda1ae6', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'floating_ip_address': '172.27.1.178', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'port_id': '73851145-2483-4c28-bf3b-f049e97c28cc', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'mac_address': 'fa:16:3e:e1:6b:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:55:59Z', 'updated_at': '2021-11-21T13:56:13Z', 'revision_number': 1, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:59Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:56:15.473836 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f86eca59-fcb3-4d62-8a2f-375ee77f011b None None] The sync data for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi is: [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'df220ba1-ef93-4c8b-a2f7-65a74fda1ae6', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'floating_ip_address': '172.27.1.178', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'port_id': '73851145-2483-4c28-bf3b-f049e97c28cc', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'mac_address': 'fa:16:3e:e1:6b:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:55:59Z', 'updated_at': '2021-11-21T13:56:13Z', 'revision_number': 1, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:59Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:56:15.541250 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55720) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:15.640273 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1340663862-network', 'tenant_id': '017390dd50484d0bb3cf04f97f3cfdb9'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:15.661735 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Made reservation on behalf of 017390dd50484d0bb3cf04f97f3cfdb9 for: {'network': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:56:15.664150 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:15.672907 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c551bab-59e9-4d00-93f0-f110a2dce9f2 None None] New status for floating IP df220ba1-ef93-4c8b-a2f7-65a74fda1ae6: ACTIVE {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 13:56:15.674952 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:15.750567 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:15.754163 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:15.777970 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] vlan segment allocate from pool success with {'vlan_id': 510, 'physical_network': 'physnet1'} {{(pid=109040) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:56:15.787409 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=31d5f715-2673-48e4-b41c-689a0cb071e0,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:15.807422 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:15.807773 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.segments_db [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Added segment ca6a4efb-a4da-49cc-b95f-38efaa9bc82c of type vlan for network 79b4766e-abe9-40ee-bfd9-f2f24b2ae559 Nov 21 13:56:15.845447 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-979191c9-7b3c-4b19-8729-11570beb51fd req-83d0e97e-d53d-4539-82a4-14fde62fcf0a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:15.848433 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-979191c9-7b3c-4b19-8729-11570beb51fd req-83d0e97e-d53d-4539-82a4-14fde62fcf0a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.50 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.0660658 Nov 21 13:56:15.856555 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:15.883947 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:15.885724 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:15.886497 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:15.944728 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4023058 Nov 21 13:56:15.947887 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55726) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:15.949782 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b53271-fd8a-49eb-af77-0ba38e0b04e8 admin admin] Pushing event updated for resources: {'Network': ['ID=79b4766e-abe9-40ee-bfd9-f2f24b2ae559,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:15.953345 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-d0c27c1d-bb7b-4e08-9854-011aa4db6642 admin admin] Request body: {'subnet': {'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1340663862-subnet', 'tenant_id': '017390dd50484d0bb3cf04f97f3cfdb9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:15.960751 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 79b4766e-abe9-40ee-bfd9-f2f24b2ae559 details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:56:15.963960 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Deleting port e97fd0d3-216a-4615-aa4a-a98857cba123 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:56:15.964305 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:16.024604 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d0c27c1d-bb7b-4e08-9854-011aa4db6642 admin admin] Made reservation on behalf of 017390dd50484d0bb3cf04f97f3cfdb9 for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:56:16.030839 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d0c27c1d-bb7b-4e08-9854-011aa4db6642 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-261005224'] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:16.111378 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] For port e97fd0d3-216a-4615-aa4a-a98857cba123, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=e97fd0d3-216a-4615-aa4a-a98857cba123,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:16.111798 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:16.298564 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b88fb87-de5f-4909-97c3-3606b0be9979 req-57ccd701-bcdf-46ca-959f-196573862742 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:16.300610 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9b88fb87-de5f-4909-97c3-3606b0be9979 req-57ccd701-bcdf-46ca-959f-196573862742 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 945 time: 0.1330061 Nov 21 13:56:16.421153 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d0c27c1d-bb7b-4e08-9854-011aa4db6642 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3086915', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-261005206'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:16.469053 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:16.469407 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:16.469723 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.l3_db [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Floating IP 96099f02-959f-43d0-8c2b-b2b87c3426ff disassociated. External IP: 172.27.1.224, port: e97fd0d3-216a-4615-aa4a-a98857cba123. Nov 21 13:56:16.470067 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling delete_port for e97fd0d3-216a-4615-aa4a-a98857cba123 owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:56:16.474610 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9b88fb87-de5f-4909-97c3-3606b0be9979 req-2a491c86-bc7d-4a85-8e30-764aa5037d04 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=349be8ab-ade8-42df-afdf-99f127cdb471&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1643414 Nov 21 13:56:16.536785 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0c27c1d-bb7b-4e08-9854-011aa4db6642 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d8009172-70e4-41f9-97b4-16c142689002,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:16.560556 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0c27c1d-bb7b-4e08-9854-011aa4db6642 admin admin] Checking segment: {'id': 'ca6a4efb-a4da-49cc-b95f-38efaa9bc82c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 510, 'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:56:16.560924 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0c27c1d-bb7b-4e08-9854-011aa4db6642 admin admin] Network hostable DHCP agents. Network: 79b4766e-abe9-40ee-bfd9-f2f24b2ae559, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:56:16.590480 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0c27c1d-bb7b-4e08-9854-011aa4db6642 admin admin] Network 79b4766e-abe9-40ee-bfd9-f2f24b2ae559 is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:56:16.601626 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-d0c27c1d-bb7b-4e08-9854-011aa4db6642 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 79b4766e-abe9-40ee-bfd9-f2f24b2ae559) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:56:16.610295 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94f4cb1e-26b9-4f3d-93f9-f2af016b20e9 None None] Network 79b4766e-abe9-40ee-bfd9-f2f24b2ae559 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:56:16.623434 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0c27c1d-bb7b-4e08-9854-011aa4db6642 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:16.624036 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d0c27c1d-bb7b-4e08-9854-011aa4db6642 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:16.651882 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-d0c27c1d-bb7b-4e08-9854-011aa4db6642 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.7022252 Nov 21 13:56:16.657236 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:16.689952 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event deleted for resources: {'Port': ['ID=e97fd0d3-216a-4615-aa4a-a98857cba123,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:16.773897 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b60cb37b-7d37-4162-b896-194f0efbbb2c None None] Network 79b4766e-abe9-40ee-bfd9-f2f24b2ae559 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:56:16.820716 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Router 65d15860-a1d7-449d-b2d9-7210d0a1d10b has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:56:16.948222 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:56:16.958600 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12cf4edc-8ce0-4d71-bce4-9426cda8aae2 None None] Sync routers for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:56:16.967996 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12cf4edc-8ce0-4d71-bce4-9426cda8aae2 None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:56:16.968657 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-12cf4edc-8ce0-4d71-bce4-9426cda8aae2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:56:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:56:16.993119 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] No DVR routers for this DVR port e97fd0d3-216a-4615-aa4a-a98857cba123 on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:56:16.995837 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:16.999074 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-979191c9-7b3c-4b19-8729-11570beb51fd req-34857dea-968e-4fb7-ac18-bfa290cd05a0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.50 "DELETE /v2.0/ports/e97fd0d3-216a-4615-aa4a-a98857cba123 HTTP/1.1" status: 204 len: 173 time: 1.1424596 Nov 21 13:56:16.999531 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1aa7ec26-0d3e-4d40-87d2-45e63ed435eb', 'name': 'network-vif-deleted', 'tag': 'e97fd0d3-216a-4615-aa4a-a98857cba123'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:17.002157 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4012397e-677f-41f9-ae78-9b90083c0e3b" -d '{"events": [{"server_uuid": "1aa7ec26-0d3e-4d40-87d2-45e63ed435eb", "name": "network-vif-deleted", "tag": "e97fd0d3-216a-4615-aa4a-a98857cba123"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:17.055899 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2db83ac0-6e26-45e0-b40e-2981e2f8e078 x-openstack-request-id: req-2db83ac0-6e26-45e0-b40e-2981e2f8e078 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:17.056433 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1aa7ec26-0d3e-4d40-87d2-45e63ed435eb", "name": "network-vif-deleted", "tag": "e97fd0d3-216a-4615-aa4a-a98857cba123", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:17.056841 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-2db83ac0-6e26-45e0-b40e-2981e2f8e078 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:17.057418 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1aa7ec26-0d3e-4d40-87d2-45e63ed435eb', 'name': 'network-vif-deleted', 'tag': 'e97fd0d3-216a-4615-aa4a-a98857cba123', 'status': 'completed', 'code': 200} Nov 21 13:56:17.100381 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-12cf4edc-8ce0-4d71-bce4-9426cda8aae2 None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:56:17.309684 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-12cf4edc-8ce0-4d71-bce4-9426cda8aae2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 5, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:56:17.339039 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12cf4edc-8ce0-4d71-bce4-9426cda8aae2 None None] Checking router: 65d15860-a1d7-449d-b2d9-7210d0a1d10b for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:56:17.347936 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12cf4edc-8ce0-4d71-bce4-9426cda8aae2 None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:56:17.348538 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-12cf4edc-8ce0-4d71-bce4-9426cda8aae2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:56:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:56:17.593057 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-12cf4edc-8ce0-4d71-bce4-9426cda8aae2 None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:56:17.598083 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0fc64e6d-b75c-4f9f-9497-d0728a4b454c req-a2d9eb59-2e33-474f-900a-304c79117e89 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=1aa7ec26-0d3e-4d40-87d2-45e63ed435eb HTTP/1.1" status: 200 len: 210 time: 0.0324140 Nov 21 13:56:17.788844 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-12cf4edc-8ce0-4d71-bce4-9426cda8aae2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 5, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:56:17.814007 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12cf4edc-8ce0-4d71-bce4-9426cda8aae2 None None] The sync data for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi is: [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 5, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:56:18.050510 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-039d58ea-358b-4980-b4d3-3104085c0049 None None] New status for floating IP 96099f02-959f-43d0-8c2b-b2b87c3426ff: DOWN {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 13:56:18.490386 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-ad3186a9-1ee1-4633-bee5-8ec5c0954e61 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:18.491726 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-ad3186a9-1ee1-4633-bee5-8ec5c0954e61 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/networks?id=79b4766e-abe9-40ee-bfd9-f2f24b2ae559 HTTP/1.1" status: 200 len: 809 time: 0.0962245 Nov 21 13:56:18.506595 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-a26cb33d-7541-4755-8f8c-222c8756eca4 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/quotas/017390dd50484d0bb3cf04f97f3cfdb9 HTTP/1.1" status: 200 len: 375 time: 0.0093672 Nov 21 13:56:18.539583 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-6b5b7a7a-997b-44a0-b4c4-9edbcbddb4be tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=017390dd50484d0bb3cf04f97f3cfdb9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0280573 Nov 21 13:56:18.625235 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-e99db7ed-cdda-46e7-9a8b-cd555c50dd91 service neutron] 10.222.0.11 "GET /v2.0/networks/79b4766e-abe9-40ee-bfd9-f2f24b2ae559?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0786762 Nov 21 13:56:18.685137 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55768) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:18.716009 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-cd42cca7-8010-49bb-84d9-2f9e5b41f3ca service neutron] 10.222.0.11 "GET /v2.0/networks/79b4766e-abe9-40ee-bfd9-f2f24b2ae559?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841277 Nov 21 13:56:18.739048 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0d9e47f3-7f52-45ff-a4db-03cb578188c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:18.762567 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0d9e47f3-7f52-45ff-a4db-03cb578188c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:18.809806 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0d9e47f3-7f52-45ff-a4db-03cb578188c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:18.812994 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0d9e47f3-7f52-45ff-a4db-03cb578188c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:18.814180 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-0d9e47f3-7f52-45ff-a4db-03cb578188c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "DELETE /v2.0/security-groups/349be8ab-ade8-42df-afdf-99f127cdb471 HTTP/1.1" status: 204 len: 168 time: 0.1280377 Nov 21 13:56:18.820299 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55772) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:18.825407 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d9e47f3-7f52-45ff-a4db-03cb578188c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=349be8ab-ade8-42df-afdf-99f127cdb471,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:18.856503 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.api.v2.resource [None req-a620d207-cfbb-4717-aa45-2f4b913abc88 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] show failed (client error): The resource could not be found. Nov 21 13:56:18.857915 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-a620d207-cfbb-4717-aa45-2f4b913abc88 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups/349be8ab-ade8-42df-afdf-99f127cdb471 HTTP/1.1" status: 404 len: 347 time: 0.0356917 Nov 21 13:56:18.860853 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55776) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:18.889215 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-aa5e9b3b-a1ca-4425-917b-50c23fccff20 req-9fa19221-941c-4998-8b3f-369014230bb2 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 210 time: 0.0418847 Nov 21 13:56:19.009501 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-54c33d2d-1b15-49f9-9eb4-954db67bc079 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Deleting port f63a919e-eec6-4f31-9b4c-30d7f633c35d {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:56:19.009958 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-54c33d2d-1b15-49f9-9eb4-954db67bc079 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.089775 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-54c33d2d-1b15-49f9-9eb4-954db67bc079 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.090108 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-54c33d2d-1b15-49f9-9eb4-954db67bc079 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.106223 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-54c33d2d-1b15-49f9-9eb4-954db67bc079 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling delete_port for f63a919e-eec6-4f31-9b4c-30d7f633c35d owned by network:floatingip {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:56:19.248114 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-54c33d2d-1b15-49f9-9eb4-954db67bc079 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.273872 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54c33d2d-1b15-49f9-9eb4-954db67bc079 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event deleted for resources: {'Port': ['ID=f63a919e-eec6-4f31-9b4c-30d7f633c35d,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:19.335295 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-54c33d2d-1b15-49f9-9eb4-954db67bc079 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.337914 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-54c33d2d-1b15-49f9-9eb4-954db67bc079 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.339067 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-54c33d2d-1b15-49f9-9eb4-954db67bc079 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "DELETE /v2.0/floatingips/96099f02-959f-43d0-8c2b-b2b87c3426ff HTTP/1.1" status: 204 len: 168 time: 0.4767425 Nov 21 13:56:19.579257 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55788) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:19.584395 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-875ccb18-efcf-47b9-8c8e-d09d600d9a62 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1107963018', 'description': 'tempest-description--1606174818'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:19.606117 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-875ccb18-efcf-47b9-8c8e-d09d600d9a62 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.669442 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-875ccb18-efcf-47b9-8c8e-d09d600d9a62 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.672796 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-875ccb18-efcf-47b9-8c8e-d09d600d9a62 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.699195 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-875ccb18-efcf-47b9-8c8e-d09d600d9a62 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.700412 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-875ccb18-efcf-47b9-8c8e-d09d600d9a62 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.1196167 Nov 21 13:56:19.703335 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55790) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:19.704265 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-875ccb18-efcf-47b9-8c8e-d09d600d9a62 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fe1f10dd-0418-4dff-bc67-cd614e6291d3,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:19.708561 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-b237a42d-e223-4027-ae55-5c9df2a77ace tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Request body: {'security_group_rule': {'security_group_id': 'fe1f10dd-0418-4dff-bc67-cd614e6291d3', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:19.735308 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b237a42d-e223-4027-ae55-5c9df2a77ace tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.784594 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b237a42d-e223-4027-ae55-5c9df2a77ace tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.788441 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b237a42d-e223-4027-ae55-5c9df2a77ace tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.807649 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b237a42d-e223-4027-ae55-5c9df2a77ace tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=75163f81-7638-4608-b33f-f33a5fc610e1,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:19.815674 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b237a42d-e223-4027-ae55-5c9df2a77ace tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.816903 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-b237a42d-e223-4027-ae55-5c9df2a77ace tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1124887 Nov 21 13:56:19.819561 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55792) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:19.824344 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-be768514-8113-4cec-aa50-629b13b54359 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Request body: {'security_group_rule': {'security_group_id': 'fe1f10dd-0418-4dff-bc67-cd614e6291d3', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:19.860666 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-be768514-8113-4cec-aa50-629b13b54359 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.929418 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-384c413f-c6c8-4e6d-aecd-97bf29dc1274 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:19.930622 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-be768514-8113-4cec-aa50-629b13b54359 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.931312 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-384c413f-c6c8-4e6d-aecd-97bf29dc1274 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.50 "GET /v2.0/networks?id=79b4766e-abe9-40ee-bfd9-f2f24b2ae559 HTTP/1.1" status: 200 len: 809 time: 0.1091597 Nov 21 13:56:19.934819 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-be768514-8113-4cec-aa50-629b13b54359 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.952189 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-2c1cf7ed-270a-48fc-87d4-1d4c5abcd978 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Request body: {'port': {'device_id': '27eea7fb-f06b-42eb-9503-ea9712ab787d', 'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559', 'admin_state_up': True, 'tenant_id': '017390dd50484d0bb3cf04f97f3cfdb9'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:19.958754 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be768514-8113-4cec-aa50-629b13b54359 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=11656250-0f00-458d-862f-8ebd8c08bb0e,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:19.966686 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-be768514-8113-4cec-aa50-629b13b54359 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:19.971026 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-be768514-8113-4cec-aa50-629b13b54359 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1504288 Nov 21 13:56:19.973485 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 55796) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:19.979765 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Request body: {'floatingip': {'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:20.010324 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2ff79599-793b-4833-9d73-5cd8a4716889 req-0e1213c4-a6e3-453d-8d39-afed6c4ad254 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 210 time: 0.0378451 Nov 21 13:56:20.029638 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.078351 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-2c1cf7ed-270a-48fc-87d4-1d4c5abcd978 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Made reservation on behalf of 017390dd50484d0bb3cf04f97f3cfdb9 for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:56:20.081854 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-2c1cf7ed-270a-48fc-87d4-1d4c5abcd978 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.139943 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.218271 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-2c1cf7ed-270a-48fc-87d4-1d4c5abcd978 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Allocated IP 172.20.0.2 (79b4766e-abe9-40ee-bfd9-f2f24b2ae559/d8009172-70e4-41f9-97b4-16c142689002/4c2e5ca6-3438-48b9-9122-4ec3b5782d9f) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:56:20.252817 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Allocated IP 172.27.1.180 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/0880122b-f282-4b3c-884b-3b040afb4b37) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:56:20.353324 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.373603 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-2c1cf7ed-270a-48fc-87d4-1d4c5abcd978 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.387660 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.408571 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-2c1cf7ed-270a-48fc-87d4-1d4c5abcd978 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.433804 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:56:20.438132 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:56:20.440724 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:56:20.452075 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-2c1cf7ed-270a-48fc-87d4-1d4c5abcd978 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Network 79b4766e-abe9-40ee-bfd9-f2f24b2ae559 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:56:20.455400 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-2c1cf7ed-270a-48fc-87d4-1d4c5abcd978 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:56:20.459000 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-2c1cf7ed-270a-48fc-87d4-1d4c5abcd978 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:56:20.467619 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event updated for resources: {'Port': ['ID=0880122b-f282-4b3c-884b-3b040afb4b37,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:20.492710 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c1cf7ed-270a-48fc-87d4-1d4c5abcd978 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Pushing event updated for resources: {'Port': ['ID=4c2e5ca6-3438-48b9-9122-4ec3b5782d9f,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:20.521160 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-2c1cf7ed-270a-48fc-87d4-1d4c5abcd978 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:20.521769 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-2c1cf7ed-270a-48fc-87d4-1d4c5abcd978 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.537249 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-2c1cf7ed-270a-48fc-87d4-1d4c5abcd978 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5947645 Nov 21 13:56:20.540008 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.551467 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Request body: {'port': {'device_id': '27eea7fb-f06b-42eb-9503-ea9712ab787d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:20.572869 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.581494 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device e97fd0d3-216a-4615-aa4a-a98857cba123 no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:56:20.601857 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: e97fd0d3-216a-4615-aa4a-a98857cba123 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:56:20.602486 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device e97fd0d3-216a-4615-aa4a-a98857cba123 not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:56:20.603631 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.721771 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.726223 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2298230'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.799790 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event updated for resources: {'Port': ['ID=0880122b-f282-4b3c-884b-3b040afb4b37,revision_number=2']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:20.806746 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.822870 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:20.824214 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-0307eb16-85fa-472c-8aed-2ccf87986720 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.8497894 Nov 21 13:56:21.031068 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-26322cbd-dbd4-4ab9-9085-8a39ba1ed9eb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-securitygroup--1107963018&fields=id&tenant_id=389c281a19bb49e583633f57108f7f69 HTTP/1.1" status: 200 len: 267 time: 0.0437195 Nov 21 13:56:21.147978 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08403e66-a92e-466b-a00f-473d0be394e5 req-64ce3a4f-e500-428c-a197-8173c3ef7c75 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:21.149371 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-64ce3a4f-e500-428c-a197-8173c3ef7c75 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/networks?id=ea19090b-8034-4904-8b6c-1752befe0b5a HTTP/1.1" status: 200 len: 811 time: 0.1113331 Nov 21 13:56:21.153847 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:56:21.163578 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:21.169753 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-a6b1e536-860d-4db4-8169-37767f1b91d6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/quotas/389c281a19bb49e583633f57108f7f69 HTTP/1.1" status: 200 len: 375 time: 0.0097680 Nov 21 13:56:21.181905 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Transition to ACTIVE for port object 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:56:21.189428 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e115e3d3-6035-4bcb-ad2d-304ca3c76729 req-f18bb9e6-128f-4c59-add2-b61be42ea845 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:21.190939 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e115e3d3-6035-4bcb-ad2d-304ca3c76729 req-f18bb9e6-128f-4c59-add2-b61be42ea845 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 931 time: 0.0745699 Nov 21 13:56:21.192103 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:21.228833 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-8a41f7e1-fa10-4a9d-beec-02755abffc7c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=389c281a19bb49e583633f57108f7f69&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0511227 Nov 21 13:56:21.266235 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Pushing event updated for resources: {'Port': ['ID=4c2e5ca6-3438-48b9-9122-4ec3b5782d9f,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:21.318628 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e115e3d3-6035-4bcb-ad2d-304ca3c76729 req-c28811df-e480-4c69-b8a0-cbc4370fed24 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1005192 Nov 21 13:56:21.340865 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-f73a64b2-5b35-468c-bf14-1ffd57c11dfa service neutron] 10.222.0.11 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0982900 Nov 21 13:56:21.357591 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Attempting to bind port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:56:21.357939 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Attempting to bind port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': 'ca6a4efb-a4da-49cc-b95f-38efaa9bc82c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 510, 'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:56:21.358270 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Attempting to bind port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f on network 79b4766e-abe9-40ee-bfd9-f2f24b2ae559 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:56:21.363792 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f on network 79b4766e-abe9-40ee-bfd9-f2f24b2ae559 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:56:21.364265 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Attempting to bind port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f on network 79b4766e-abe9-40ee-bfd9-f2f24b2ae559 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:56:21.369268 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 55, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:56:21.369611 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Checking segment: {'id': 'ca6a4efb-a4da-49cc-b95f-38efaa9bc82c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 510, 'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:56:21.370001 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Bound using segment: {'id': 'ca6a4efb-a4da-49cc-b95f-38efaa9bc82c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 510, 'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:56:21.370436 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Bound port: 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ca6a4efb-a4da-49cc-b95f-38efaa9bc82c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 510, 'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:56:21.370797 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:21.439088 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] For port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:56:21.442262 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] For port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=4c2e5ca6-3438-48b9-9122-4ec3b5782d9f,segment=NetworkSegment(ca6a4efb-a4da-49cc-b95f-38efaa9bc82c),segment_id=ca6a4efb-a4da-49cc-b95f-38efaa9bc82c)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:56:21.442458 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-cfa2e0c5-9683-4c43-a96b-bbdece75b9ad service neutron] 10.222.0.11 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0944321 Nov 21 13:56:21.446155 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:21.481816 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:21.482863 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:21.484594 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] 10.222.0.50 "PUT /v2.0/ports/4c2e5ca6-3438-48b9-9122-4ec3b5782d9f HTTP/1.1" status: 200 len: 1093 time: 0.9372363 Nov 21 13:56:21.490763 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '27eea7fb-f06b-42eb-9503-ea9712ab787d', 'tag': '4c2e5ca6-3438-48b9-9122-4ec3b5782d9f'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:21.493762 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-45220a7b-d707-45c3-9908-467395f51241" -d '{"events": [{"name": "network-changed", "server_uuid": "27eea7fb-f06b-42eb-9503-ea9712ab787d", "tag": "4c2e5ca6-3438-48b9-9122-4ec3b5782d9f"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:21.525133 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ab41895-4888-4c7c-b0c2-ba8f1c2e0050 service neutron] Pushing event updated for resources: {'Port': ['ID=4c2e5ca6-3438-48b9-9122-4ec3b5782d9f,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:21.547157 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6ae363b6-7fb8-44c4-b90b-88a803e3d14e x-openstack-request-id: req-6ae363b6-7fb8-44c4-b90b-88a803e3d14e {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:21.547668 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "27eea7fb-f06b-42eb-9503-ea9712ab787d", "tag": "4c2e5ca6-3438-48b9-9122-4ec3b5782d9f", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:21.549577 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-6ae363b6-7fb8-44c4-b90b-88a803e3d14e {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:21.549980 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '27eea7fb-f06b-42eb-9503-ea9712ab787d', 'tag': '4c2e5ca6-3438-48b9-9122-4ec3b5782d9f', 'status': 'completed', 'code': 200} Nov 21 13:56:21.590644 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-440eafb3-80a6-4183-83e2-84cf26d54a55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:21.592174 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-440eafb3-80a6-4183-83e2-84cf26d54a55 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=017390dd50484d0bb3cf04f97f3cfdb9&device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 1096 time: 0.0582247 Nov 21 13:56:21.623171 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ff4d54ad-8f68-425b-9b12-a3f52e3d5752 req-938a0305-5a8b-4d59-84cb-729b5717b976 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 210 time: 0.0353014 Nov 21 13:56:21.656568 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-bfc50c5d-be90-48c4-903d-387c3a16f9f3 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=4c2e5ca6-3438-48b9-9122-4ec3b5782d9f HTTP/1.1" status: 200 len: 217 time: 0.0550032 Nov 21 13:56:21.706560 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-276861cb-e9f7-472f-8e35-431de5d8899f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:21.708077 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-276861cb-e9f7-472f-8e35-431de5d8899f service neutron] 10.222.0.50 "GET /v2.0/subnets?id=d8009172-70e4-41f9-97b4-16c142689002 HTTP/1.1" status: 200 len: 849 time: 0.0441120 Nov 21 13:56:21.741361 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-74ac87dd-3271-4b23-9211-e476f462f15f service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=79b4766e-abe9-40ee-bfd9-f2f24b2ae559&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0247166 Nov 21 13:56:21.835462 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-a0460548-a63b-41ee-b773-cb0746cb2af6 service neutron] 10.222.0.50 "GET /v2.0/networks/79b4766e-abe9-40ee-bfd9-f2f24b2ae559?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868375 Nov 21 13:56:21.932751 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a9719cf-7934-4c2a-b5cd-5ef85fdfd4c8 req-2b2f73f0-14fc-407d-a773-7bf4f81aa633 service neutron] 10.222.0.50 "GET /v2.0/networks/79b4766e-abe9-40ee-bfd9-f2f24b2ae559?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893407 Nov 21 13:56:22.021622 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45220a7b-d707-45c3-9908-467395f51241 req-3e54bfb5-9e76-4577-adca-4a77dde0dc3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:22.023140 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-45220a7b-d707-45c3-9908-467395f51241 req-3e54bfb5-9e76-4577-adca-4a77dde0dc3d service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=017390dd50484d0bb3cf04f97f3cfdb9&device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 1096 time: 0.0426080 Nov 21 13:56:22.136249 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45220a7b-d707-45c3-9908-467395f51241 req-c3635602-c0e7-46aa-a17f-09c60665bd83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:22.137724 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-45220a7b-d707-45c3-9908-467395f51241 req-c3635602-c0e7-46aa-a17f-09c60665bd83 service neutron] 10.222.0.50 "GET /v2.0/networks?id=79b4766e-abe9-40ee-bfd9-f2f24b2ae559 HTTP/1.1" status: 200 len: 910 time: 0.0924218 Nov 21 13:56:22.192273 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-45220a7b-d707-45c3-9908-467395f51241 req-5cca8439-09af-45f6-9641-02a234339972 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=4c2e5ca6-3438-48b9-9122-4ec3b5782d9f HTTP/1.1" status: 200 len: 217 time: 0.0356371 Nov 21 13:56:22.246245 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45220a7b-d707-45c3-9908-467395f51241 req-2d4e1809-d6c2-499d-885c-6198c229213f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:22.249293 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-45220a7b-d707-45c3-9908-467395f51241 req-2d4e1809-d6c2-499d-885c-6198c229213f service neutron] 10.222.0.50 "GET /v2.0/subnets?id=d8009172-70e4-41f9-97b4-16c142689002 HTTP/1.1" status: 200 len: 849 time: 0.0491464 Nov 21 13:56:22.314077 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-45220a7b-d707-45c3-9908-467395f51241 req-666e503f-b8de-409a-8353-8e2d39638a5a service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=79b4766e-abe9-40ee-bfd9-f2f24b2ae559&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0456877 Nov 21 13:56:22.425694 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb7f3bda-8e3b-4946-be7c-6b7cf581287d req-9ba11a8a-fdb2-4e7f-82f2-54fb8d964c92 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:22.427267 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-eb7f3bda-8e3b-4946-be7c-6b7cf581287d req-9ba11a8a-fdb2-4e7f-82f2-54fb8d964c92 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.1497443 Nov 21 13:56:22.431961 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdec68e8-fbdd-483b-b80f-e38c11132e30 req-6a77a9be-0d89-42b0-a4fc-8be08b48db11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:22.433345 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bdec68e8-fbdd-483b-b80f-e38c11132e30 req-6a77a9be-0d89-42b0-a4fc-8be08b48db11 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=406bef8592334a749f671da6881b0cf5&device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 1137 time: 0.1416142 Nov 21 13:56:22.443430 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508d5401-45fb-4e75-b96e-217d71939957 req-627eb24c-050f-4897-9e7c-24e71c7cce85 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:22.445364 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-508d5401-45fb-4e75-b96e-217d71939957 req-627eb24c-050f-4897-9e7c-24e71c7cce85 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 943 time: 0.0587566 Nov 21 13:56:22.495718 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-508d5401-45fb-4e75-b96e-217d71939957 req-815a8b0d-7c12-4967-b0d6-4cd8185edb3e tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440526 Nov 21 13:56:22.540486 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-45220a7b-d707-45c3-9908-467395f51241 req-4ad206c6-f80f-4802-9c6f-2177068b27af service neutron] 10.222.0.50 "GET /v2.0/networks/79b4766e-abe9-40ee-bfd9-f2f24b2ae559?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2012420 Nov 21 13:56:22.571333 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:22.676171 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-eb7f3bda-8e3b-4946-be7c-6b7cf581287d req-7744239b-b330-491e-adc5-53f62b6f26b3 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2398541 Nov 21 13:56:22.727387 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c954f1c8-6f74-4321-ab6b-c51d2f2fd346 req-118fa3ce-903f-43d5-9658-be970abd67c1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 210 time: 0.0256197 Nov 21 13:56:22.739750 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdec68e8-fbdd-483b-b80f-e38c11132e30 req-47ba5763-13e1-425d-b75f-8c81968b6d9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:22.741223 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bdec68e8-fbdd-483b-b80f-e38c11132e30 req-47ba5763-13e1-425d-b75f-8c81968b6d9d service neutron] 10.222.0.50 "GET /v2.0/networks?id=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 HTTP/1.1" status: 200 len: 915 time: 0.2908070 Nov 21 13:56:22.809316 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08403e66-a92e-466b-a00f-473d0be394e5 req-fd5302e0-b47d-484c-a618-70235ea55b73 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:22.810738 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-fd5302e0-b47d-484c-a618-70235ea55b73 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.50 "GET /v2.0/networks?id=ea19090b-8034-4904-8b6c-1752befe0b5a HTTP/1.1" status: 200 len: 811 time: 0.2845690 Nov 21 13:56:22.814836 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-45220a7b-d707-45c3-9908-467395f51241 req-edb68829-b3b8-4cc2-ac0c-a709d44a177f service neutron] 10.222.0.50 "GET /v2.0/networks/79b4766e-abe9-40ee-bfd9-f2f24b2ae559?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2532959 Nov 21 13:56:22.836781 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bdec68e8-fbdd-483b-b80f-e38c11132e30 req-8ba36d2c-5a85-45d6-b5b6-907b3fa4dc16 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0f9a92e8-efd7-45cc-b13f-25658f0506ad HTTP/1.1" status: 200 len: 1000 time: 0.0840707 Nov 21 13:56:22.917156 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-5b805a6d-2e6c-4463-94a2-b11b199181a9 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.50 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=389c281a19bb49e583633f57108f7f69 HTTP/1.1" status: 200 len: 380 time: 0.0901594 Nov 21 13:56:22.922389 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdec68e8-fbdd-483b-b80f-e38c11132e30 req-6a108d1b-fdd0-4e83-b18f-75dfd5f8283c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:22.923783 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bdec68e8-fbdd-483b-b80f-e38c11132e30 req-6a108d1b-fdd0-4e83-b18f-75dfd5f8283c service neutron] 10.222.0.50 "GET /v2.0/subnets?id=7cdb43d5-ad8a-4fcf-8b29-113b86f21514 HTTP/1.1" status: 200 len: 853 time: 0.0682523 Nov 21 13:56:22.937906 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-08403e66-a92e-466b-a00f-473d0be394e5 req-e25c3a0f-65b1-468d-89e2-2b81f6dc6bdb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Request body: {'port': {'device_id': 'fe7c81c3-cb32-476d-97c8-9a0d8d19f156', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'admin_state_up': True, 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'security_groups': ['fe1f10dd-0418-4dff-bc67-cd614e6291d3']}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:23.036339 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdec68e8-fbdd-483b-b80f-e38c11132e30 req-1e8d6de1-8dbc-4843-a31c-d0565ba0bf77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:23.037810 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bdec68e8-fbdd-483b-b80f-e38c11132e30 req-1e8d6de1-8dbc-4843-a31c-d0565ba0bf77 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0963492 Nov 21 13:56:23.120822 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-08403e66-a92e-466b-a00f-473d0be394e5 req-e25c3a0f-65b1-468d-89e2-2b81f6dc6bdb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Made reservation on behalf of 389c281a19bb49e583633f57108f7f69 for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:56:23.124241 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-08403e66-a92e-466b-a00f-473d0be394e5 req-e25c3a0f-65b1-468d-89e2-2b81f6dc6bdb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:23.175631 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bdec68e8-fbdd-483b-b80f-e38c11132e30 req-e16f6750-44b3-4268-b1a7-9050cd3d633a service neutron] 10.222.0.50 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1246743 Nov 21 13:56:23.339212 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-08403e66-a92e-466b-a00f-473d0be394e5 req-e25c3a0f-65b1-468d-89e2-2b81f6dc6bdb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Allocated IP 172.20.0.4 (ea19090b-8034-4904-8b6c-1752befe0b5a/8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0/8f627980-8d41-4f62-bfa8-683b4cdc0b4c) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:56:23.342469 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bdec68e8-fbdd-483b-b80f-e38c11132e30 req-252e8569-35f8-43ef-b660-7de1094ad82d service neutron] 10.222.0.50 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1383767 Nov 21 13:56:23.483719 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-08403e66-a92e-466b-a00f-473d0be394e5 req-e25c3a0f-65b1-468d-89e2-2b81f6dc6bdb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:23.520724 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-08403e66-a92e-466b-a00f-473d0be394e5 req-e25c3a0f-65b1-468d-89e2-2b81f6dc6bdb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:23.567167 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-08403e66-a92e-466b-a00f-473d0be394e5 req-e25c3a0f-65b1-468d-89e2-2b81f6dc6bdb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Network ea19090b-8034-4904-8b6c-1752befe0b5a is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:56:23.571932 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-08403e66-a92e-466b-a00f-473d0be394e5 req-e25c3a0f-65b1-468d-89e2-2b81f6dc6bdb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:56:23.582518 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-08403e66-a92e-466b-a00f-473d0be394e5 req-e25c3a0f-65b1-468d-89e2-2b81f6dc6bdb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:56:23.587846 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e25c3a0f-65b1-468d-89e2-2b81f6dc6bdb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event updated for resources: {'Port': ['ID=8f627980-8d41-4f62-bfa8-683b4cdc0b4c,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:23.652585 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08403e66-a92e-466b-a00f-473d0be394e5 req-e25c3a0f-65b1-468d-89e2-2b81f6dc6bdb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:23.653217 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-08403e66-a92e-466b-a00f-473d0be394e5 req-e25c3a0f-65b1-468d-89e2-2b81f6dc6bdb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:23.671077 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4e2dc5a-f087-4c34-958b-0a97e30d29cd req-d2574ab0-8708-4b6f-85dd-8ca58c35b454 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:23.672608 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f4e2dc5a-f087-4c34-958b-0a97e30d29cd req-d2574ab0-8708-4b6f-85dd-8ca58c35b454 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 943 time: 0.1043794 Nov 21 13:56:23.682680 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-e25c3a0f-65b1-468d-89e2-2b81f6dc6bdb tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7481840 Nov 21 13:56:23.702940 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Request body: {'port': {'device_id': 'fe7c81c3-cb32-476d-97c8-9a0d8d19f156', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:23.779439 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f4e2dc5a-f087-4c34-958b-0a97e30d29cd req-0bac1d41-6709-48d7-b6e0-32c30caea5cd tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957778 Nov 21 13:56:23.784744 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:23.815245 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5087acd1-e87c-428a-90d4-36481b108d1a req-0c5e463a-8281-4ba0-9e38-66e50721187b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:23.820790 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-68cc49f3-3f40-496c-aaf4-65c34b4ce7bb None None] Provisioning complete for port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:56:23.821255 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-68cc49f3-3f40-496c-aaf4-65c34b4ce7bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:23.824463 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5087acd1-e87c-428a-90d4-36481b108d1a req-0c5e463a-8281-4ba0-9e38-66e50721187b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.0656333 Nov 21 13:56:23.860456 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-68cc49f3-3f40-496c-aaf4-65c34b4ce7bb None None] Port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 13:56:23.891990 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5087acd1-e87c-428a-90d4-36481b108d1a req-1c8d54cc-ef76-488b-b2cd-f093ff949335 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0663888 Nov 21 13:56:24.000766 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87820a66-b180-4f99-8586-a16e6170018d req-58d8eb70-1a41-48c8-817d-809f9197160c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:24.002269 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-87820a66-b180-4f99-8586-a16e6170018d req-58d8eb70-1a41-48c8-817d-809f9197160c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 931 time: 0.0979612 Nov 21 13:56:24.081607 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-87820a66-b180-4f99-8586-a16e6170018d req-a309c805-0bb4-462c-b044-ed8972d012ce tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe1f10dd-0418-4dff-bc67-cd614e6291d3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0732026 Nov 21 13:56:24.130370 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8f627980-8d41-4f62-bfa8-683b4cdc0b4c {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:56:24.137761 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:24.149669 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Transition to ACTIVE for port object 8f627980-8d41-4f62-bfa8-683b4cdc0b4c will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:56:24.154277 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:24.208930 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Pushing event updated for resources: {'Port': ['ID=8f627980-8d41-4f62-bfa8-683b4cdc0b4c,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:24.283893 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Attempting to bind port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:56:24.284241 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Attempting to bind port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:56:24.284568 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Attempting to bind port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c on network ea19090b-8034-4904-8b6c-1752befe0b5a {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:56:24.290700 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c on network ea19090b-8034-4904-8b6c-1752befe0b5a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:56:24.291057 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Attempting to bind port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c on network ea19090b-8034-4904-8b6c-1752befe0b5a {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:56:24.296296 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 56, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:56:24.296639 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Checking segment: {'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:56:24.297029 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Bound using segment: {'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:56:24.297458 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Bound port: 8f627980-8d41-4f62-bfa8-683b4cdc0b4c, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f3a2505-9e61-424e-8456-2758b99b070c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 507, 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:56:24.297846 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:24.360774 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] For port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:56:24.363723 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] For port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8f627980-8d41-4f62-bfa8-683b4cdc0b4c,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:56:24.368036 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:24.404199 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:24.405181 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:24.407716 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] 10.222.0.50 "PUT /v2.0/ports/8f627980-8d41-4f62-bfa8-683b4cdc0b4c HTTP/1.1" status: 200 len: 1093 time: 0.7086630 Nov 21 13:56:24.407716 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fe7c81c3-cb32-476d-97c8-9a0d8d19f156', 'tag': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:24.410186 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-95c9aede-40b2-478c-8961-473344bfb56f" -d '{"events": [{"name": "network-changed", "server_uuid": "fe7c81c3-cb32-476d-97c8-9a0d8d19f156", "tag": "8f627980-8d41-4f62-bfa8-683b4cdc0b4c"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:24.433275 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc0033c4-ffb4-40c6-8529-45c13a90682b service neutron] Pushing event updated for resources: {'Port': ['ID=8f627980-8d41-4f62-bfa8-683b4cdc0b4c,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:24.454421 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-26ec76ab-1e19-422a-bc30-32eb37f15fa4 x-openstack-request-id: req-26ec76ab-1e19-422a-bc30-32eb37f15fa4 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:24.454724 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fe7c81c3-cb32-476d-97c8-9a0d8d19f156", "tag": "8f627980-8d41-4f62-bfa8-683b4cdc0b4c", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:24.455763 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-26ec76ab-1e19-422a-bc30-32eb37f15fa4 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:24.456674 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fe7c81c3-cb32-476d-97c8-9a0d8d19f156', 'tag': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c', 'status': 'completed', 'code': 200} Nov 21 13:56:24.505785 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08403e66-a92e-466b-a00f-473d0be394e5 req-3d626aea-d6d6-4f1e-947e-464f25fea265 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:24.507297 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-3d626aea-d6d6-4f1e-947e-464f25fea265 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=389c281a19bb49e583633f57108f7f69&device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 1096 time: 0.0423470 Nov 21 13:56:24.556213 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-5bc2c392-4202-4dc0-9bdc-b62a37e4477a service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8f627980-8d41-4f62-bfa8-683b4cdc0b4c HTTP/1.1" status: 200 len: 217 time: 0.0372491 Nov 21 13:56:24.599228 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:56:24.609727 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08403e66-a92e-466b-a00f-473d0be394e5 req-78323302-b08e-45ab-b9cc-982d63f0c61f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:24.611218 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-78323302-b08e-45ab-b9cc-982d63f0c61f service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0 HTTP/1.1" status: 200 len: 850 time: 0.0474844 Nov 21 13:56:24.657935 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08403e66-a92e-466b-a00f-473d0be394e5 req-a7ef6b44-c42f-4abc-80f0-f4224deac9ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:24.660050 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-a7ef6b44-c42f-4abc-80f0-f4224deac9ce service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=ea19090b-8034-4904-8b6c-1752befe0b5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0411751 Nov 21 13:56:24.696404 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=4c2e5ca6-3438-48b9-9122-4ec3b5782d9f,segment=NetworkSegment(ca6a4efb-a4da-49cc-b95f-38efaa9bc82c),segment_id=ca6a4efb-a4da-49cc-b95f-38efaa9bc82c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:24.710055 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '4c2e5ca6-3438-48b9-9122-4ec3b5782d9f', 'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559', 'port_id': '4c2e5ca6-3438-48b9-9122-4ec3b5782d9f', 'mac_address': 'fa:16:3e:65:2d:6d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 510, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd8009172-70e4-41f9-97b4-16c142689002', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:56:24.748642 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:24.756793 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-857b9399-2227-489b-9944-118e54886395 service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856378 Nov 21 13:56:24.765095 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:56:24.787038 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=4c2e5ca6-3438-48b9-9122-4ec3b5782d9f,segment=NetworkSegment(ca6a4efb-a4da-49cc-b95f-38efaa9bc82c),segment_id=ca6a4efb-a4da-49cc-b95f-38efaa9bc82c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:24.792032 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:24.839966 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=4c2e5ca6-3438-48b9-9122-4ec3b5782d9f,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:24.853787 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-08403e66-a92e-466b-a00f-473d0be394e5 req-69c11f9f-c7a5-44db-8aea-78b2dc9cdba3 service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833528 Nov 21 13:56:24.910806 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df92e79-a2bb-4272-a607-755d273f49bd req-9a8cf34c-de34-4cb7-b891-7896082936c5 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:24.912343 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7df92e79-a2bb-4272-a607-755d273f49bd req-9a8cf34c-de34-4cb7-b891-7896082936c5 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 944 time: 0.0510218 Nov 21 13:56:24.947872 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c9aede-40b2-478c-8961-473344bfb56f req-5c8ad8ff-1980-4175-b4be-f7c51b90f89d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:24.949383 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c9aede-40b2-478c-8961-473344bfb56f req-5c8ad8ff-1980-4175-b4be-f7c51b90f89d service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=389c281a19bb49e583633f57108f7f69&device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 1096 time: 0.0428843 Nov 21 13:56:24.964384 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7df92e79-a2bb-4272-a607-755d273f49bd req-8b02410c-2874-4b44-a759-17659ad7abe9 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443830 Nov 21 13:56:25.054915 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['4c2e5ca6-3438-48b9-9122-4ec3b5782d9f'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:56:25.080696 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bc731ef-6d53-4365-ba3b-5423798939ae req-cca26ba9-6b03-4708-8714-4a029b075257 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:25.082162 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2bc731ef-6d53-4365-ba3b-5423798939ae req-cca26ba9-6b03-4708-8714-4a029b075257 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.1076634 Nov 21 13:56:25.097879 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c9aede-40b2-478c-8961-473344bfb56f req-c8b280f7-c645-45ca-9e91-b28d5f093368 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:25.099268 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c9aede-40b2-478c-8961-473344bfb56f req-c8b280f7-c645-45ca-9e91-b28d5f093368 service neutron] 10.222.0.50 "GET /v2.0/networks?id=ea19090b-8034-4904-8b6c-1752befe0b5a HTTP/1.1" status: 200 len: 912 time: 0.1337559 Nov 21 13:56:25.162656 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c9aede-40b2-478c-8961-473344bfb56f req-bb48697c-ddc9-47ee-9c74-7a8ad9049976 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8f627980-8d41-4f62-bfa8-683b4cdc0b4c HTTP/1.1" status: 200 len: 217 time: 0.0481243 Nov 21 13:56:25.201156 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2bc731ef-6d53-4365-ba3b-5423798939ae req-fa7f11eb-cb57-4edd-a3ad-e78ce7a1338f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1115408 Nov 21 13:56:25.213021 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f1a29b-1cca-47e4-aa22-9aef65690ebc req-13d439c2-02a6-4f9d-97da-ad193129b3a6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:25.214581 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-18f1a29b-1cca-47e4-aa22-9aef65690ebc req-13d439c2-02a6-4f9d-97da-ad193129b3a6 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 943 time: 0.0556760 Nov 21 13:56:25.237171 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c9aede-40b2-478c-8961-473344bfb56f req-3c1106af-e2ad-4fe9-85a0-4b441113835f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:25.238694 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c9aede-40b2-478c-8961-473344bfb56f req-3c1106af-e2ad-4fe9-85a0-4b441113835f service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0 HTTP/1.1" status: 200 len: 850 time: 0.0525622 Nov 21 13:56:25.262196 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-18f1a29b-1cca-47e4-aa22-9aef65690ebc req-0c75b8e6-1f10-4d3f-a3f4-235289f97b6a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe1f10dd-0418-4dff-bc67-cd614e6291d3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407934 Nov 21 13:56:25.290857 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c9aede-40b2-478c-8961-473344bfb56f req-1a08a827-9b00-4ec4-96bc-eaf1d0413c26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:25.292381 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c9aede-40b2-478c-8961-473344bfb56f req-1a08a827-9b00-4ec4-96bc-eaf1d0413c26 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=ea19090b-8034-4904-8b6c-1752befe0b5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0403991 Nov 21 13:56:25.383320 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c9aede-40b2-478c-8961-473344bfb56f req-2d04fbb2-27c2-4300-8b68-7b3d1a30e82a service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823553 Nov 21 13:56:25.473835 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c9aede-40b2-478c-8961-473344bfb56f req-6646753c-7dd1-4c80-9e61-f5a78709cc05 service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0788713 Nov 21 13:56:26.081712 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-055d87e5-b331-44e3-934b-a8c40105d01c req-9983969c-0694-46de-9270-4b15fd7af07a tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:26.083065 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-055d87e5-b331-44e3-934b-a8c40105d01c req-9983969c-0694-46de-9270-4b15fd7af07a tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 944 time: 0.0511756 Nov 21 13:56:26.129426 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-055d87e5-b331-44e3-934b-a8c40105d01c req-2b4c4f93-bed9-427a-8691-86f0f5725c9f tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403891 Nov 21 13:56:26.322318 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c96614e8-d06b-41dd-bd13-00734e852dd3 req-c9067431-d1da-4485-a90b-daffadc081bd tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:26.323775 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c96614e8-d06b-41dd-bd13-00734e852dd3 req-c9067431-d1da-4485-a90b-daffadc081bd tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.0528781 Nov 21 13:56:26.375516 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-401300fe-5033-4f6e-bfed-c2edb9904233 req-510effd1-704d-4365-9882-c9e860137f08 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:26.377513 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-401300fe-5033-4f6e-bfed-c2edb9904233 req-510effd1-704d-4365-9882-c9e860137f08 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 943 time: 0.0474136 Nov 21 13:56:26.384108 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c96614e8-d06b-41dd-bd13-00734e852dd3 req-bb1b5e21-251c-4f10-a2af-e1d5b10c98eb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0543122 Nov 21 13:56:26.424491 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-401300fe-5033-4f6e-bfed-c2edb9904233 req-dfab1275-89a1-48d7-b71f-cde83fe41657 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe1f10dd-0418-4dff-bc67-cd614e6291d3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405734 Nov 21 13:56:26.614171 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:56:26.661190 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:56:26.664589 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:56:26.664950 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:26.737321 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:26.761128 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '27eea7fb-f06b-42eb-9503-ea9712ab787d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c2e5ca6-3438-48b9-9122-4ec3b5782d9f'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:26.763323 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7620bb8-a7f3-4849-9e2b-3df48db4e0fb" -d '{"events": [{"server_uuid": "27eea7fb-f06b-42eb-9503-ea9712ab787d", "name": "network-vif-plugged", "status": "completed", "tag": "4c2e5ca6-3438-48b9-9122-4ec3b5782d9f"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:26.776444 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=4c2e5ca6-3438-48b9-9122-4ec3b5782d9f,segment=NetworkSegment(ca6a4efb-a4da-49cc-b95f-38efaa9bc82c),segment_id=ca6a4efb-a4da-49cc-b95f-38efaa9bc82c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:26.781224 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:26.811599 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b39d8cd7-68e3-492a-bdc8-6d1db5f9a399 x-openstack-request-id: req-b39d8cd7-68e3-492a-bdc8-6d1db5f9a399 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:26.811926 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "27eea7fb-f06b-42eb-9503-ea9712ab787d", "name": "network-vif-plugged", "status": "completed", "tag": "4c2e5ca6-3438-48b9-9122-4ec3b5782d9f", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:26.812181 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-b39d8cd7-68e3-492a-bdc8-6d1db5f9a399 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:26.812566 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '27eea7fb-f06b-42eb-9503-ea9712ab787d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c2e5ca6-3438-48b9-9122-4ec3b5782d9f', 'code': 200} Nov 21 13:56:26.833940 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=4c2e5ca6-3438-48b9-9122-4ec3b5782d9f,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:26.987115 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44ed8e51-6763-485d-9b96-0e610186e7b6 req-24f30bbe-62e5-45c3-8eb6-ef0bfd4bf7bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:26.988622 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-44ed8e51-6763-485d-9b96-0e610186e7b6 req-24f30bbe-62e5-45c3-8eb6-ef0bfd4bf7bf service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 1098 time: 0.0401490 Nov 21 13:56:27.037325 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-44ed8e51-6763-485d-9b96-0e610186e7b6 req-29587677-7738-4e9e-bf29-5cbbab93d8c9 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366406 Nov 21 13:56:27.250204 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb6d5168-c513-42f5-9151-0d9a0b94e22f req-dc40da64-b697-40ea-b271-82e7772a04c9 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:27.252122 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-cb6d5168-c513-42f5-9151-0d9a0b94e22f req-dc40da64-b697-40ea-b271-82e7772a04c9 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 945 time: 0.0475726 Nov 21 13:56:27.301274 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-cb6d5168-c513-42f5-9151-0d9a0b94e22f req-f66847ea-76fd-4674-b4c8-6883d4e4c916 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430279 Nov 21 13:56:27.505188 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08bfd0c4-2715-4db6-9422-2ecb9d5c252f req-b5c560fa-951e-4625-9246-b985025a6543 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:27.506568 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-08bfd0c4-2715-4db6-9422-2ecb9d5c252f req-b5c560fa-951e-4625-9246-b985025a6543 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.0544581 Nov 21 13:56:27.535647 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e35144c5-f0bb-40ce-b143-ffd19665ea88 req-1d472b02-01c4-407d-825c-ef3266b74c5e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:27.537125 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e35144c5-f0bb-40ce-b143-ffd19665ea88 req-1d472b02-01c4-407d-825c-ef3266b74c5e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 943 time: 0.0485680 Nov 21 13:56:27.571833 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-08bfd0c4-2715-4db6-9422-2ecb9d5c252f req-986994b7-00b5-4553-9510-1d550e40c794 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0591888 Nov 21 13:56:27.588661 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e35144c5-f0bb-40ce-b143-ffd19665ea88 req-8d7b337c-e32c-464c-a3dc-196797e6572a tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe1f10dd-0418-4dff-bc67-cd614e6291d3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442474 Nov 21 13:56:28.415107 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d09d295-637e-44a2-ba9d-734c2c05c963 req-709603e7-4919-4965-a2ad-13f002dc2aff tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:28.416595 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9d09d295-637e-44a2-ba9d-734c2c05c963 req-709603e7-4919-4965-a2ad-13f002dc2aff tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 945 time: 0.0479364 Nov 21 13:56:28.467547 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9d09d295-637e-44a2-ba9d-734c2c05c963 req-7ad68621-49d0-46ca-8309-b1608feef59e tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450244 Nov 21 13:56:28.629382 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 8f627980-8d41-4f62-bfa8-683b4cdc0b4c details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:56:28.700753 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-167907ed-501d-439d-98d3-0e681845ec4c req-488f7cba-0126-4000-9d24-272ac890de7b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:28.702677 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-167907ed-501d-439d-98d3-0e681845ec4c req-488f7cba-0126-4000-9d24-272ac890de7b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.0573320 Nov 21 13:56:28.761168 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8f627980-8d41-4f62-bfa8-683b4cdc0b4c,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:28.775980 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-167907ed-501d-439d-98d3-0e681845ec4c req-fcf4bf43-ed6d-4226-86f8-0be7c6b0270b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0663610 Nov 21 13:56:28.776504 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'port_id': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c', 'mac_address': 'fa:16:3e:59:a5:4f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 507, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:56:28.817662 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:28.832527 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8f627980-8d41-4f62-bfa8-683b4cdc0b4c {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:56:28.854804 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8f627980-8d41-4f62-bfa8-683b4cdc0b4c,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:28.859686 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:28.918958 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=8f627980-8d41-4f62-bfa8-683b4cdc0b4c,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:28.992568 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f7a4dce-c387-4230-8374-c83ee5c1e99c req-e69ea1f6-a385-4aa8-81f6-43840d3393cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:28.994051 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5f7a4dce-c387-4230-8374-c83ee5c1e99c req-e69ea1f6-a385-4aa8-81f6-43840d3393cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 943 time: 0.3261626 Nov 21 13:56:29.051115 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5f7a4dce-c387-4230-8374-c83ee5c1e99c req-ad02e750-ce24-4b6a-8237-e5b0d6079fc0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe1f10dd-0418-4dff-bc67-cd614e6291d3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504134 Nov 21 13:56:29.142842 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['8f627980-8d41-4f62-bfa8-683b4cdc0b4c'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:56:29.146531 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e62ab3ce-5c6f-41d5-b994-7ce9930a9d8d req-456298bc-8cea-4d6c-b6f1-ebd5120639b6 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:29.148034 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e62ab3ce-5c6f-41d5-b994-7ce9930a9d8d req-456298bc-8cea-4d6c-b6f1-ebd5120639b6 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 945 time: 0.0486178 Nov 21 13:56:29.200320 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e62ab3ce-5c6f-41d5-b994-7ce9930a9d8d req-6f65bb42-1caf-42fb-9f09-2330fe53d793 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462964 Nov 21 13:56:29.895032 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a96ae4c4-2bd7-4e76-a64d-a57744e5cfdb req-a479ac43-694e-4dd6-b100-d021d6991969 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:29.896504 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a96ae4c4-2bd7-4e76-a64d-a57744e5cfdb req-a479ac43-694e-4dd6-b100-d021d6991969 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.0473170 Nov 21 13:56:29.953844 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a96ae4c4-2bd7-4e76-a64d-a57744e5cfdb req-0889d8ae-5648-4e88-902b-05249f007c0d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0514491 Nov 21 13:56:30.165086 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3142db7d-b236-44c1-bc2e-aa12fb77469a req-e43f664a-4049-4ca5-a107-034943f4a4b5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:30.166706 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3142db7d-b236-44c1-bc2e-aa12fb77469a req-e43f664a-4049-4ca5-a107-034943f4a4b5 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 944 time: 0.0476279 Nov 21 13:56:30.172920 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c7dff4b9-caef-4ce3-8282-b63423c5f30e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:30.215650 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3142db7d-b236-44c1-bc2e-aa12fb77469a req-075ad5fa-7b4e-4ece-84db-31139fe921dc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe1f10dd-0418-4dff-bc67-cd614e6291d3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413744 Nov 21 13:56:30.322487 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71c465ed-ac74-4967-8972-db4f65463b72 req-c3244a89-2b1c-492e-8f87-5e0ea1cd20ab tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:30.324001 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-71c465ed-ac74-4967-8972-db4f65463b72 req-c3244a89-2b1c-492e-8f87-5e0ea1cd20ab tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 945 time: 0.0527964 Nov 21 13:56:30.369650 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-71c465ed-ac74-4967-8972-db4f65463b72 req-0985675f-1f62-4c14-ae79-1ee35870a034 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396583 Nov 21 13:56:30.641400 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 8f627980-8d41-4f62-bfa8-683b4cdc0b4c up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:56:30.678301 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 req-6f7cf70b-9596-4596-9861-61bbd170466f tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:30.679748 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 req-6f7cf70b-9596-4596-9861-61bbd170466f tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.50 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 945 time: 0.0468540 Nov 21 13:56:30.689095 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:56:30.693375 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:56:30.693739 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:30.773670 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:30.777811 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 req-df16934d-d9f5-4a2f-a393-90daec0ab15c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Deleting port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:56:30.778152 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 req-df16934d-d9f5-4a2f-a393-90daec0ab15c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:30.796145 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fe7c81c3-cb32-476d-97c8-9a0d8d19f156', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:30.798366 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-705b6271-91ea-445e-9b4f-1b356110e1b2" -d '{"events": [{"server_uuid": "fe7c81c3-cb32-476d-97c8-9a0d8d19f156", "name": "network-vif-plugged", "status": "completed", "tag": "8f627980-8d41-4f62-bfa8-683b4cdc0b4c"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:30.811710 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8f627980-8d41-4f62-bfa8-683b4cdc0b4c,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:30.816512 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:30.841923 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-56584025-85b3-4df7-a34c-bb341a846927 x-openstack-request-id: req-56584025-85b3-4df7-a34c-bb341a846927 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:30.842991 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fe7c81c3-cb32-476d-97c8-9a0d8d19f156", "name": "network-vif-plugged", "status": "completed", "tag": "8f627980-8d41-4f62-bfa8-683b4cdc0b4c", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:30.843414 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-56584025-85b3-4df7-a34c-bb341a846927 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:30.844288 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fe7c81c3-cb32-476d-97c8-9a0d8d19f156', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c', 'code': 200} Nov 21 13:56:30.872391 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=8f627980-8d41-4f62-bfa8-683b4cdc0b4c,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:30.873365 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 req-df16934d-d9f5-4a2f-a393-90daec0ab15c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] For port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=4c2e5ca6-3438-48b9-9122-4ec3b5782d9f,segment=NetworkSegment(ca6a4efb-a4da-49cc-b95f-38efaa9bc82c),segment_id=ca6a4efb-a4da-49cc-b95f-38efaa9bc82c)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:30.873732 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 req-df16934d-d9f5-4a2f-a393-90daec0ab15c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:30.886805 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 req-df16934d-d9f5-4a2f-a393-90daec0ab15c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling delete_port for 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:56:31.042141 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 req-df16934d-d9f5-4a2f-a393-90daec0ab15c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:31.047316 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d36e4d6-826e-4ecc-85b6-f21a5399dd5d req-47dae36b-fe2c-4c77-9262-80765a2dbb53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:31.049374 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1d36e4d6-826e-4ecc-85b6-f21a5399dd5d req-47dae36b-fe2c-4c77-9262-80765a2dbb53 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 1098 time: 0.0608923 Nov 21 13:56:31.053469 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['4c2e5ca6-3438-48b9-9122-4ec3b5782d9f'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:56:31.075772 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-562b8c5e-9c25-4a70-8897-ebaeb02bbc34 req-ace7fbf9-1487-4d1c-9a93-26cd0ddac614 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:31.077319 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-562b8c5e-9c25-4a70-8897-ebaeb02bbc34 req-ace7fbf9-1487-4d1c-9a93-26cd0ddac614 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.0560136 Nov 21 13:56:31.080413 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df16934d-d9f5-4a2f-a393-90daec0ab15c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Pushing event deleted for resources: {'Port': ['ID=4c2e5ca6-3438-48b9-9122-4ec3b5782d9f,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:31.139179 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 req-df16934d-d9f5-4a2f-a393-90daec0ab15c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] No DVR routers for this DVR port 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:56:31.143779 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 req-df16934d-d9f5-4a2f-a393-90daec0ab15c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:31.143952 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-562b8c5e-9c25-4a70-8897-ebaeb02bbc34 req-a5bdfbc8-6a8e-4405-9489-d557bce5ef35 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0561576 Nov 21 13:56:31.147470 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-77fa8725-a4d9-4f85-86f6-b08e33b10e64 req-df16934d-d9f5-4a2f-a393-90daec0ab15c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.50 "DELETE /v2.0/ports/4c2e5ca6-3438-48b9-9122-4ec3b5782d9f HTTP/1.1" status: 204 len: 173 time: 0.4578409 Nov 21 13:56:31.147470 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '27eea7fb-f06b-42eb-9503-ea9712ab787d', 'name': 'network-vif-deleted', 'tag': '4c2e5ca6-3438-48b9-9122-4ec3b5782d9f'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:31.149698 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07c8701b-e1da-424b-8273-2bfb576422ef" -d '{"events": [{"server_uuid": "27eea7fb-f06b-42eb-9503-ea9712ab787d", "name": "network-vif-deleted", "tag": "4c2e5ca6-3438-48b9-9122-4ec3b5782d9f"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:31.155507 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1d36e4d6-826e-4ecc-85b6-f21a5399dd5d req-52610a7c-57be-4629-8f0c-e69df48337bf service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=fe1f10dd-0418-4dff-bc67-cd614e6291d3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0833716 Nov 21 13:56:31.187231 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5a7d6b8-d91d-4386-b7bd-98390d1938ae x-openstack-request-id: req-c5a7d6b8-d91d-4386-b7bd-98390d1938ae {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:31.187526 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "27eea7fb-f06b-42eb-9503-ea9712ab787d", "name": "network-vif-deleted", "tag": "4c2e5ca6-3438-48b9-9122-4ec3b5782d9f", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:31.187777 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-c5a7d6b8-d91d-4386-b7bd-98390d1938ae {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:31.188202 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '27eea7fb-f06b-42eb-9503-ea9712ab787d', 'name': 'network-vif-deleted', 'tag': '4c2e5ca6-3438-48b9-9122-4ec3b5782d9f', 'status': 'completed', 'code': 200} Nov 21 13:56:31.330949 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-205296ca-6d30-49b3-9011-f5760cb78c34 req-fea99369-eca0-406e-bfde-bdd520237be3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:31.332597 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-205296ca-6d30-49b3-9011-f5760cb78c34 req-fea99369-eca0-406e-bfde-bdd520237be3 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 945 time: 0.0515499 Nov 21 13:56:31.380676 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-205296ca-6d30-49b3-9011-f5760cb78c34 req-74f5fce5-f709-4cb5-9823-66219e333ec7 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe1f10dd-0418-4dff-bc67-cd614e6291d3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424137 Nov 21 13:56:31.463937 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-dcbbb419-eec1-41e0-8897-30aeade2bbde req-0e317d2e-82ea-47f5-9375-3b141d3dc376 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=27eea7fb-f06b-42eb-9503-ea9712ab787d HTTP/1.1" status: 200 len: 210 time: 0.0257335 Nov 21 13:56:32.263496 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e6a73c-a596-48a9-b353-d85fe0ace4e3 req-f58754aa-9f34-41bd-8aeb-15cef339b283 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:32.267663 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-49e6a73c-a596-48a9-b353-d85fe0ace4e3 req-f58754aa-9f34-41bd-8aeb-15cef339b283 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.0525453 Nov 21 13:56:32.335549 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-49e6a73c-a596-48a9-b353-d85fe0ace4e3 req-0aaefc2f-3851-4b5a-bb37-136269dc0223 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0614135 Nov 21 13:56:32.499186 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb1ac4bc-f0f2-4361-9831-b114b0f06cd8 req-55e89f05-c7dc-4905-9117-c6c141e05631 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:32.500918 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-fb1ac4bc-f0f2-4361-9831-b114b0f06cd8 req-55e89f05-c7dc-4905-9117-c6c141e05631 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 945 time: 0.0544486 Nov 21 13:56:32.548330 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-fb1ac4bc-f0f2-4361-9831-b114b0f06cd8 req-abc90216-3a20-4d53-8eeb-652a0b276250 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe1f10dd-0418-4dff-bc67-cd614e6291d3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411384 Nov 21 13:56:32.573682 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-357c60c1-867f-403c-86e6-e1540b4f53ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:32.666564 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bafba58d-7ba8-4643-bf05-84a09d52d802 req-071961cd-464f-4264-9968-48c3e8de342f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:32.668231 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bafba58d-7ba8-4643-bf05-84a09d52d802 req-071961cd-464f-4264-9968-48c3e8de342f tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 945 time: 0.0494430 Nov 21 13:56:32.677632 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 55948) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:56:32.682029 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-33542842-3858-499d-a7e6-896ba0b92556 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Request body: {'floatingip': {'port_id': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:32.719773 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-33542842-3858-499d-a7e6-896ba0b92556 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:32.753091 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-c133a777-356c-410a-9375-ae9c79c8ad1e tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:32.754491 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-c133a777-356c-410a-9375-ae9c79c8ad1e tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/networks?id=79b4766e-abe9-40ee-bfd9-f2f24b2ae559 HTTP/1.1" status: 200 len: 809 time: 0.1010017 Nov 21 13:56:32.770125 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-82e5b6f6-5c61-4824-a8b2-af629c2a850d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/quotas/017390dd50484d0bb3cf04f97f3cfdb9 HTTP/1.1" status: 200 len: 375 time: 0.0096004 Nov 21 13:56:32.804602 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-efb77888-6f84-477e-9311-9441111c6629 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=017390dd50484d0bb3cf04f97f3cfdb9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0289116 Nov 21 13:56:32.899793 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-c9ef55b3-afbe-4f43-8aa0-da60415a4ad6 service neutron] 10.222.0.11 "GET /v2.0/networks/79b4766e-abe9-40ee-bfd9-f2f24b2ae559?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881815 Nov 21 13:56:32.990777 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-06c7aab0-b861-4ef6-8fc3-0d09e5666698 service neutron] 10.222.0.11 "GET /v2.0/networks/79b4766e-abe9-40ee-bfd9-f2f24b2ae559?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848670 Nov 21 13:56:33.170538 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-63eac586-bebf-4116-9677-fbf9690fee38 req-85b6ab44-5490-4682-8232-2ab408a584aa tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 210 time: 0.0323641 Nov 21 13:56:33.183529 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-33542842-3858-499d-a7e6-896ba0b92556 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:33.188775 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-33542842-3858-499d-a7e6-896ba0b92556 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:33.301520 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.l3_db [None req-33542842-3858-499d-a7e6-896ba0b92556 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Floating IP f8b3c7bf-cb9f-4d02-9d64-455c864da562 associated. External IP: 172.27.1.180, port: 8f627980-8d41-4f62-bfa8-683b4cdc0b4c. Nov 21 13:56:33.456790 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8840603-d024-4678-8352-6c0152af07ad req-7c481a8c-df2d-4f8a-ae11-79b80e59cab8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:33.458295 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e8840603-d024-4678-8352-6c0152af07ad req-7c481a8c-df2d-4f8a-ae11-79b80e59cab8 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.0538108 Nov 21 13:56:33.532574 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-33542842-3858-499d-a7e6-896ba0b92556 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Router 65d15860-a1d7-449d-b2d9-7210d0a1d10b has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:56:33.536410 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e8840603-d024-4678-8352-6c0152af07ad req-b1dfddbb-152d-431f-8375-d2930938f5d0 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0713315 Nov 21 13:56:33.652386 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-33542842-3858-499d-a7e6-896ba0b92556 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:56:33.657116 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-33542842-3858-499d-a7e6-896ba0b92556 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:33.664364 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-348f4d8f-8bae-455b-aa85-9d1e24c71094 None None] Sync routers for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:56:33.675521 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-348f4d8f-8bae-455b-aa85-9d1e24c71094 None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:56:33.676456 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-348f4d8f-8bae-455b-aa85-9d1e24c71094 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:56:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:56:33.687538 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-33542842-3858-499d-a7e6-896ba0b92556 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "PUT /v2.0/floatingips/f8b3c7bf-cb9f-4d02-9d64-455c864da562 HTTP/1.1" status: 200 len: 991 time: 1.0063481 Nov 21 13:56:33.687538 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fe7c81c3-cb32-476d-97c8-9a0d8d19f156', 'tag': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:33.689006 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-480dfac1-6263-478e-8bee-f3a74ff6ad70" -d '{"events": [{"name": "network-changed", "server_uuid": "fe7c81c3-cb32-476d-97c8-9a0d8d19f156", "tag": "8f627980-8d41-4f62-bfa8-683b4cdc0b4c"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:33.728162 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fe401329-b1c3-4241-9cd1-08fa1a8e6238 x-openstack-request-id: req-fe401329-b1c3-4241-9cd1-08fa1a8e6238 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:33.728485 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fe7c81c3-cb32-476d-97c8-9a0d8d19f156", "tag": "8f627980-8d41-4f62-bfa8-683b4cdc0b4c", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:33.728744 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-fe401329-b1c3-4241-9cd1-08fa1a8e6238 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:33.729145 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fe7c81c3-cb32-476d-97c8-9a0d8d19f156', 'tag': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c', 'status': 'completed', 'code': 200} Nov 21 13:56:33.792853 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-348f4d8f-8bae-455b-aa85-9d1e24c71094 None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:56:33.819430 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-d6a2f0a1-1f92-442c-a15a-507feff557c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:33.821011 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-d6a2f0a1-1f92-442c-a15a-507feff557c6 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=389c281a19bb49e583633f57108f7f69&device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 1098 time: 0.0435870 Nov 21 13:56:33.895145 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:33.918872 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-a742e885-869f-41e1-b642-57dc616d40b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:33.920428 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-a742e885-869f-41e1-b642-57dc616d40b3 service neutron] 10.222.0.50 "GET /v2.0/networks?id=ea19090b-8034-4904-8b6c-1752befe0b5a HTTP/1.1" status: 200 len: 912 time: 0.0872474 Nov 21 13:56:33.989787 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-97225f65-73ae-41d1-9eed-613f0b97e93f service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=8f627980-8d41-4f62-bfa8-683b4cdc0b4c HTTP/1.1" status: 200 len: 999 time: 0.0598211 Nov 21 13:56:34.049807 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-20c0ead7-e23d-4368-b651-124197542cb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:34.051185 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-20c0ead7-e23d-4368-b651-124197542cb7 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0 HTTP/1.1" status: 200 len: 850 time: 0.0481827 Nov 21 13:56:34.100374 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-08ca2e9c-88e7-41f5-8aee-dc461cbd2078 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:34.101862 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-08ca2e9c-88e7-41f5-8aee-dc461cbd2078 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=ea19090b-8034-4904-8b6c-1752befe0b5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0407169 Nov 21 13:56:34.154930 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-348f4d8f-8bae-455b-aa85-9d1e24c71094 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'f8b3c7bf-cb9f-4d02-9d64-455c864da562', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'floating_ip_address': '172.27.1.180', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'port_id': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 535, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'mac_address': 'fa:16:3e:59:a5:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fe7c81c3-cb32-476d-97c8-9a0d8d19f156', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:56:20Z', 'updated_at': '2021-11-21T13:56:33Z', 'revision_number': 1, 'project_id': '389c281a19bb49e583633f57108f7f69', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 5, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:56:34.191360 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-348f4d8f-8bae-455b-aa85-9d1e24c71094 None None] Checking router: 65d15860-a1d7-449d-b2d9-7210d0a1d10b for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:56:34.200794 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-348f4d8f-8bae-455b-aa85-9d1e24c71094 None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:56:34.201513 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-348f4d8f-8bae-455b-aa85-9d1e24c71094 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:56:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:56:34.289057 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b3e8ae75-a587-49ae-a6ff-a4de0d90173e req-d0422fcc-86ee-4887-8e36-6dcad6217a95 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 210 time: 0.0429251 Nov 21 13:56:34.300454 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-8e636caf-905c-4e61-9b58-e199d4e2efdf service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1901031 Nov 21 13:56:34.323183 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-8ebe6d58-25d0-4ca6-8d46-ff65a022286b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:34.324695 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-8ebe6d58-25d0-4ca6-8d46-ff65a022286b tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.50 "GET /v2.0/networks?id=79b4766e-abe9-40ee-bfd9-f2f24b2ae559 HTTP/1.1" status: 200 len: 809 time: 0.1728938 Nov 21 13:56:34.340668 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-fbbf1c4d-0dd3-4f7b-bfdb-274c6c641021 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Request body: {'port': {'device_id': 'e9dc0276-9434-487d-a1ac-e95f0c499129', 'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559', 'admin_state_up': True, 'tenant_id': '017390dd50484d0bb3cf04f97f3cfdb9'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:34.343548 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-348f4d8f-8bae-455b-aa85-9d1e24c71094 None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:56:34.479990 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-480dfac1-6263-478e-8bee-f3a74ff6ad70 req-b4093b87-a5ab-48e2-958e-a2d5e920b0a5 service neutron] 10.222.0.50 "GET /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1695123 Nov 21 13:56:34.504382 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-fbbf1c4d-0dd3-4f7b-bfdb-274c6c641021 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Made reservation on behalf of 017390dd50484d0bb3cf04f97f3cfdb9 for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:56:34.508175 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-fbbf1c4d-0dd3-4f7b-bfdb-274c6c641021 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:34.570503 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-348f4d8f-8bae-455b-aa85-9d1e24c71094 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'f8b3c7bf-cb9f-4d02-9d64-455c864da562', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'floating_ip_address': '172.27.1.180', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'port_id': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 535, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'mac_address': 'fa:16:3e:59:a5:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fe7c81c3-cb32-476d-97c8-9a0d8d19f156', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:56:20Z', 'updated_at': '2021-11-21T13:56:33Z', 'revision_number': 1, 'project_id': '389c281a19bb49e583633f57108f7f69', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 5, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:56:34.603743 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-348f4d8f-8bae-455b-aa85-9d1e24c71094 None None] The sync data for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi is: [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'f8b3c7bf-cb9f-4d02-9d64-455c864da562', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'floating_ip_address': '172.27.1.180', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'port_id': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 535, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'mac_address': 'fa:16:3e:59:a5:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fe7c81c3-cb32-476d-97c8-9a0d8d19f156', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T13:56:20Z', 'updated_at': '2021-11-21T13:56:33Z', 'revision_number': 1, 'project_id': '389c281a19bb49e583633f57108f7f69', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 5, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:56:34.637058 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-fbbf1c4d-0dd3-4f7b-bfdb-274c6c641021 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Allocated IP 172.20.0.7 (79b4766e-abe9-40ee-bfd9-f2f24b2ae559/d8009172-70e4-41f9-97b4-16c142689002/a98bf10e-b29e-4c77-8249-7c04d7ab12b9) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:56:34.661317 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641c8b5f-4c78-4ef1-85fa-25e1785bb5b4 req-61b02a11-c814-452c-827f-46e55332a6bb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:34.666750 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:56:34.669104 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-641c8b5f-4c78-4ef1-85fa-25e1785bb5b4 req-61b02a11-c814-452c-827f-46e55332a6bb tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.0646322 Nov 21 13:56:34.698175 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:56:34.698553 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 4c2e5ca6-3438-48b9-9122-4ec3b5782d9f not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:56:34.735021 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-641c8b5f-4c78-4ef1-85fa-25e1785bb5b4 req-90653db8-af8a-4c80-9f3c-bc1f3135da7f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0650465 Nov 21 13:56:34.832013 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5fb1287-56df-4791-b393-397be4b0ae07 None None] New status for floating IP f8b3c7bf-cb9f-4d02-9d64-455c864da562: ACTIVE {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 13:56:34.836818 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-fbbf1c4d-0dd3-4f7b-bfdb-274c6c641021 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:34.873948 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-fbbf1c4d-0dd3-4f7b-bfdb-274c6c641021 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:34.920533 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-fbbf1c4d-0dd3-4f7b-bfdb-274c6c641021 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Network 79b4766e-abe9-40ee-bfd9-f2f24b2ae559 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:56:34.924197 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-fbbf1c4d-0dd3-4f7b-bfdb-274c6c641021 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:56:34.930985 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-fbbf1c4d-0dd3-4f7b-bfdb-274c6c641021 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:56:34.935502 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbbf1c4d-0dd3-4f7b-bfdb-274c6c641021 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Pushing event updated for resources: {'Port': ['ID=a98bf10e-b29e-4c77-8249-7c04d7ab12b9,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:34.984276 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-fbbf1c4d-0dd3-4f7b-bfdb-274c6c641021 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:34.984858 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-fbbf1c4d-0dd3-4f7b-bfdb-274c6c641021 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:35.002066 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-fbbf1c4d-0dd3-4f7b-bfdb-274c6c641021 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6651821 Nov 21 13:56:35.014565 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Request body: {'port': {'device_id': 'e9dc0276-9434-487d-a1ac-e95f0c499129', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:56:35.066311 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:35.069592 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:35.329113 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a98bf10e-b29e-4c77-8249-7c04d7ab12b9 {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:56:35.337095 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:35.349550 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Transition to ACTIVE for port object a98bf10e-b29e-4c77-8249-7c04d7ab12b9 will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:56:35.353404 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:35.408425 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dcb11f2-07ea-49f4-9d9a-6020d771dfec req-25eed031-b225-4c01-b6ba-c4bbe36ad3ad tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:35.409907 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2dcb11f2-07ea-49f4-9d9a-6020d771dfec req-25eed031-b225-4c01-b6ba-c4bbe36ad3ad tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 943 time: 0.0513723 Nov 21 13:56:35.418871 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Pushing event updated for resources: {'Port': ['ID=a98bf10e-b29e-4c77-8249-7c04d7ab12b9,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:35.458678 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2dcb11f2-07ea-49f4-9d9a-6020d771dfec req-728abc0e-4d00-4779-8f45-8f72e997744c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426643 Nov 21 13:56:35.469952 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Attempting to bind port a98bf10e-b29e-4c77-8249-7c04d7ab12b9 on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:56:35.470376 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Attempting to bind port a98bf10e-b29e-4c77-8249-7c04d7ab12b9 by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': 'ca6a4efb-a4da-49cc-b95f-38efaa9bc82c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 510, 'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:56:35.470720 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Attempting to bind port a98bf10e-b29e-4c77-8249-7c04d7ab12b9 on network 79b4766e-abe9-40ee-bfd9-f2f24b2ae559 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:56:35.474992 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Port a98bf10e-b29e-4c77-8249-7c04d7ab12b9 on network 79b4766e-abe9-40ee-bfd9-f2f24b2ae559 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:56:35.475321 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Attempting to bind port a98bf10e-b29e-4c77-8249-7c04d7ab12b9 on network 79b4766e-abe9-40ee-bfd9-f2f24b2ae559 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:56:35.480297 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 56, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:56:35.480636 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Checking segment: {'id': 'ca6a4efb-a4da-49cc-b95f-38efaa9bc82c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 510, 'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:56:35.481022 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Bound using segment: {'id': 'ca6a4efb-a4da-49cc-b95f-38efaa9bc82c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 510, 'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:56:35.481477 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Bound port: a98bf10e-b29e-4c77-8249-7c04d7ab12b9, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ca6a4efb-a4da-49cc-b95f-38efaa9bc82c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 510, 'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:56:35.481833 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:35.551181 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] For port a98bf10e-b29e-4c77-8249-7c04d7ab12b9, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:56:35.554472 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] For port a98bf10e-b29e-4c77-8249-7c04d7ab12b9, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=a98bf10e-b29e-4c77-8249-7c04d7ab12b9,segment=NetworkSegment(ca6a4efb-a4da-49cc-b95f-38efaa9bc82c),segment_id=ca6a4efb-a4da-49cc-b95f-38efaa9bc82c)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:56:35.558094 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:35.594262 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:35.594876 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:35.596302 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] 10.222.0.50 "PUT /v2.0/ports/a98bf10e-b29e-4c77-8249-7c04d7ab12b9 HTTP/1.1" status: 200 len: 1093 time: 0.5859303 Nov 21 13:56:35.614361 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d7eed1d-4127-4b64-85f3-3a65707eb74e service neutron] Pushing event updated for resources: {'Port': ['ID=a98bf10e-b29e-4c77-8249-7c04d7ab12b9,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:35.677684 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-997e74db-ab10-4c34-8fc8-68b15bb1909f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:35.679151 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-997e74db-ab10-4c34-8fc8-68b15bb1909f service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=017390dd50484d0bb3cf04f97f3cfdb9&device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 1096 time: 0.0398064 Nov 21 13:56:35.724002 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-e6a46136-8d78-49e2-bea2-58d906975edb service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a98bf10e-b29e-4c77-8249-7c04d7ab12b9 HTTP/1.1" status: 200 len: 217 time: 0.0360281 Nov 21 13:56:35.731413 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e9dc0276-9434-487d-a1ac-e95f0c499129', 'tag': 'a98bf10e-b29e-4c77-8249-7c04d7ab12b9'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:35.733713 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f53d914e-3008-4fb0-b293-46b55a33d85f" -d '{"events": [{"name": "network-changed", "server_uuid": "e9dc0276-9434-487d-a1ac-e95f0c499129", "tag": "a98bf10e-b29e-4c77-8249-7c04d7ab12b9"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:35.772443 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95e874df-b697-4607-b131-52d572f9c241 x-openstack-request-id: req-95e874df-b697-4607-b131-52d572f9c241 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:35.772742 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e9dc0276-9434-487d-a1ac-e95f0c499129", "tag": "a98bf10e-b29e-4c77-8249-7c04d7ab12b9", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:35.772998 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-95e874df-b697-4607-b131-52d572f9c241 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:35.773391 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e9dc0276-9434-487d-a1ac-e95f0c499129', 'tag': 'a98bf10e-b29e-4c77-8249-7c04d7ab12b9', 'status': 'completed', 'code': 200} Nov 21 13:56:35.783026 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-bc5776af-096d-4b15-b6b1-c9fe89b5e1db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:35.784738 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-bc5776af-096d-4b15-b6b1-c9fe89b5e1db service neutron] 10.222.0.50 "GET /v2.0/subnets?id=d8009172-70e4-41f9-97b4-16c142689002 HTTP/1.1" status: 200 len: 849 time: 0.0537317 Nov 21 13:56:35.822397 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-103cb209-d289-475f-ac17-44620e7c2a93 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=79b4766e-abe9-40ee-bfd9-f2f24b2ae559&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0301788 Nov 21 13:56:35.852443 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:35.923149 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c168974f-f2ba-4244-bb44-bff65ed3595a req-bc93e2c3-a827-456c-8adf-dd34849737bf tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:35.925214 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c168974f-f2ba-4244-bb44-bff65ed3595a req-bc93e2c3-a827-456c-8adf-dd34849737bf tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.1051421 Nov 21 13:56:35.970251 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-0182574a-6d6f-4ccf-b245-c41d86123631 service neutron] 10.222.0.50 "GET /v2.0/networks/79b4766e-abe9-40ee-bfd9-f2f24b2ae559?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1213219 Nov 21 13:56:36.047719 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c168974f-f2ba-4244-bb44-bff65ed3595a req-f08ad3c7-ac9c-41f4-9d68-117ed70842d6 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1102014 Nov 21 13:56:36.085487 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-33e5425c-065c-4cb2-9aa0-f6fed91a944d req-a40df40a-6133-4074-bb6d-db605efb49aa service neutron] 10.222.0.50 "GET /v2.0/networks/79b4766e-abe9-40ee-bfd9-f2f24b2ae559?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1045268 Nov 21 13:56:36.167633 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-715c5a28-af4e-4801-a93c-1cd304830f88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:36.169002 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-715c5a28-af4e-4801-a93c-1cd304830f88 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=017390dd50484d0bb3cf04f97f3cfdb9&device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 1096 time: 0.0398717 Nov 21 13:56:36.256580 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-3eecf27b-dbc4-4bc5-882a-9b09f80da8fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:36.257995 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-3eecf27b-dbc4-4bc5-882a-9b09f80da8fa service neutron] 10.222.0.50 "GET /v2.0/networks?id=79b4766e-abe9-40ee-bfd9-f2f24b2ae559 HTTP/1.1" status: 200 len: 910 time: 0.0799751 Nov 21 13:56:36.304280 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-cfd6298b-79b1-4524-a1d4-2f3972be1643 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a98bf10e-b29e-4c77-8249-7c04d7ab12b9 HTTP/1.1" status: 200 len: 217 time: 0.0374804 Nov 21 13:56:36.355639 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-3c19401d-be9f-43eb-aa43-cb7ed6cebfd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:36.357213 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-3c19401d-be9f-43eb-aa43-cb7ed6cebfd8 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=d8009172-70e4-41f9-97b4-16c142689002 HTTP/1.1" status: 200 len: 849 time: 0.0417407 Nov 21 13:56:36.389363 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-c498bbf7-7752-4096-8ba7-047efcfe6245 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=79b4766e-abe9-40ee-bfd9-f2f24b2ae559&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0235288 Nov 21 13:56:36.579339 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-993d0186-e2fe-4652-b4ce-9c17c7c5651b req-02763c46-2ab6-4f4e-85b8-16feba6a7a25 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:36.581476 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-993d0186-e2fe-4652-b4ce-9c17c7c5651b req-02763c46-2ab6-4f4e-85b8-16feba6a7a25 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 943 time: 0.0504918 Nov 21 13:56:36.631080 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-993d0186-e2fe-4652-b4ce-9c17c7c5651b req-fb5bb87d-e484-4d3c-b0f1-c04433b29b1a tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436065 Nov 21 13:56:36.729743 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-4602297b-7230-47d4-af7f-6b5211df0f11 service neutron] 10.222.0.50 "GET /v2.0/networks/79b4766e-abe9-40ee-bfd9-f2f24b2ae559?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3326440 Nov 21 13:56:36.816469 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f53d914e-3008-4fb0-b293-46b55a33d85f req-795dc883-8321-4578-b4de-82cf1409c08b service neutron] 10.222.0.50 "GET /v2.0/networks/79b4766e-abe9-40ee-bfd9-f2f24b2ae559?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0787330 Nov 21 13:56:37.167219 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe47462e-4fba-4194-9658-e95ff7b0982e req-6edf657d-2ac9-4ce6-b23d-566c785cf9f0 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:37.168690 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fe47462e-4fba-4194-9658-e95ff7b0982e req-6edf657d-2ac9-4ce6-b23d-566c785cf9f0 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.0518677 Nov 21 13:56:37.226435 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fe47462e-4fba-4194-9658-e95ff7b0982e req-51d49474-3f70-4195-8197-ec6553749bbc tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0518811 Nov 21 13:56:37.755371 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc86a932-33df-43e0-9ec7-ff87e790340b req-5162b51d-9186-4f7f-9996-693fe3119218 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:37.756852 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dc86a932-33df-43e0-9ec7-ff87e790340b req-5162b51d-9186-4f7f-9996-693fe3119218 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 943 time: 0.0491040 Nov 21 13:56:37.766503 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9cde2a6-5b5b-44c7-bce4-eab1e428c9d0 req-7fadefd9-36b1-444e-8e9c-2c32ebb8f94c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:37.768212 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b9cde2a6-5b5b-44c7-bce4-eab1e428c9d0 req-7fadefd9-36b1-444e-8e9c-2c32ebb8f94c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0527611 Nov 21 13:56:37.803608 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dc86a932-33df-43e0-9ec7-ff87e790340b req-3fa05d4d-f8a3-409e-892e-a880c5fa030e tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408347 Nov 21 13:56:37.816817 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b9cde2a6-5b5b-44c7-bce4-eab1e428c9d0 req-97f885cc-098f-4500-bba9-805769f483da tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429153 Nov 21 13:56:38.343381 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1da43091-6c1c-4c8c-a78b-f62abba18cf6 req-a98668ca-54ed-405c-a688-6fae1e6727ec tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:38.344766 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1da43091-6c1c-4c8c-a78b-f62abba18cf6 req-a98668ca-54ed-405c-a688-6fae1e6727ec tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.0473588 Nov 21 13:56:38.407297 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1da43091-6c1c-4c8c-a78b-f62abba18cf6 req-6d98cde1-a61c-450e-8a9c-807a868bd3a4 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0560620 Nov 21 13:56:38.693684 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device a98bf10e-b29e-4c77-8249-7c04d7ab12b9 details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:56:38.792716 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port a98bf10e-b29e-4c77-8249-7c04d7ab12b9, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=a98bf10e-b29e-4c77-8249-7c04d7ab12b9,segment=NetworkSegment(ca6a4efb-a4da-49cc-b95f-38efaa9bc82c),segment_id=ca6a4efb-a4da-49cc-b95f-38efaa9bc82c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:38.805072 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': 'a98bf10e-b29e-4c77-8249-7c04d7ab12b9', 'network_id': '79b4766e-abe9-40ee-bfd9-f2f24b2ae559', 'port_id': 'a98bf10e-b29e-4c77-8249-7c04d7ab12b9', 'mac_address': 'fa:16:3e:26:ff:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 510, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd8009172-70e4-41f9-97b4-16c142689002', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:56:38.842669 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:38.858074 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a98bf10e-b29e-4c77-8249-7c04d7ab12b9 {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:56:38.880699 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port a98bf10e-b29e-4c77-8249-7c04d7ab12b9, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=a98bf10e-b29e-4c77-8249-7c04d7ab12b9,segment=NetworkSegment(ca6a4efb-a4da-49cc-b95f-38efaa9bc82c),segment_id=ca6a4efb-a4da-49cc-b95f-38efaa9bc82c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:38.885071 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:38.937614 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15473978-b7bf-4590-a308-421b1d1b23f6 req-fd831666-5402-4cac-a8a0-39747731c6b2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:38.938418 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8615495a-6ba9-4789-9d70-f43afa16ab29 req-7ab4c740-6d49-4d88-a528-6abd9af44d0a tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:38.939769 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-15473978-b7bf-4590-a308-421b1d1b23f6 req-fd831666-5402-4cac-a8a0-39747731c6b2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0513022 Nov 21 13:56:38.941393 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8615495a-6ba9-4789-9d70-f43afa16ab29 req-7ab4c740-6d49-4d88-a528-6abd9af44d0a tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 944 time: 0.0676482 Nov 21 13:56:38.941837 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=a98bf10e-b29e-4c77-8249-7c04d7ab12b9,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:38.949264 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:56:38.949571 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:56:38.949926 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:56:38.950270 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:56:38.950609 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:56:38.950945 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:56:38.951279 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:56:38.951609 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:56:38.951993 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:56:38.952331 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:56:38.952655 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:56:38.952978 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:56:38.989833 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8615495a-6ba9-4789-9d70-f43afa16ab29 req-1a87298c-0d22-4157-a4c0-670be6f41ae6 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426936 Nov 21 13:56:38.996073 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-15473978-b7bf-4590-a308-421b1d1b23f6 req-fdf6c74d-ac7d-40a2-ab57-37de9dd39b8d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0502822 Nov 21 13:56:39.206814 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['a98bf10e-b29e-4c77-8249-7c04d7ab12b9'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:56:39.522177 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1de43844-c9f8-4ae9-8f61-0cc4df0edf39 req-69f04c4c-a097-404d-91fa-5703931bd8bc tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:39.523527 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1de43844-c9f8-4ae9-8f61-0cc4df0edf39 req-69f04c4c-a097-404d-91fa-5703931bd8bc tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.0487354 Nov 21 13:56:39.584429 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1de43844-c9f8-4ae9-8f61-0cc4df0edf39 req-db4b947b-e301-4cfd-a2fb-a2dcb523e505 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=42126e3d-39be-4ee1-969d-6af11887f875&id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0549140 Nov 21 13:56:39.615573 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:56:40.106131 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f7f4c35-7b21-40e0-96ae-079facea8fcf req-12a5e96b-6272-410a-9cb9-0808f0da9f2c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:40.107610 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7f7f4c35-7b21-40e0-96ae-079facea8fcf req-12a5e96b-6272-410a-9cb9-0808f0da9f2c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 944 time: 0.0479066 Nov 21 13:56:40.108347 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b22ad2-e6d8-4364-9703-b86793311f06 req-6fdb8bce-c8ed-48a7-acd6-6c0ee1e7d024 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:40.109804 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-04b22ad2-e6d8-4364-9703-b86793311f06 req-6fdb8bce-c8ed-48a7-acd6-6c0ee1e7d024 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0464885 Nov 21 13:56:40.159519 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7f7f4c35-7b21-40e0-96ae-079facea8fcf req-2c9c6e5a-6dc7-4b4c-bfa8-3c98f73cba60 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454047 Nov 21 13:56:40.165375 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-04b22ad2-e6d8-4364-9703-b86793311f06 req-39fc736f-5dc6-4b9a-9029-c112be97ae4f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487554 Nov 21 13:56:40.707922 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device a98bf10e-b29e-4c77-8249-7c04d7ab12b9 up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:56:40.758309 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port a98bf10e-b29e-4c77-8249-7c04d7ab12b9 completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:56:40.761886 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port a98bf10e-b29e-4c77-8249-7c04d7ab12b9 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:56:40.762248 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:40.838740 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:40.860179 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9dc0276-9434-487d-a1ac-e95f0c499129', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a98bf10e-b29e-4c77-8249-7c04d7ab12b9'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:40.862468 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-40061bf8-084e-4d7a-9700-324171254242" -d '{"events": [{"server_uuid": "e9dc0276-9434-487d-a1ac-e95f0c499129", "name": "network-vif-plugged", "status": "completed", "tag": "a98bf10e-b29e-4c77-8249-7c04d7ab12b9"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:40.875152 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port a98bf10e-b29e-4c77-8249-7c04d7ab12b9, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=a98bf10e-b29e-4c77-8249-7c04d7ab12b9,segment=NetworkSegment(ca6a4efb-a4da-49cc-b95f-38efaa9bc82c),segment_id=ca6a4efb-a4da-49cc-b95f-38efaa9bc82c)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:40.879369 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:40.902715 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a15fb48a-d349-430b-99cb-ddb0c0ab3d1f x-openstack-request-id: req-a15fb48a-d349-430b-99cb-ddb0c0ab3d1f {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:40.902963 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e9dc0276-9434-487d-a1ac-e95f0c499129", "name": "network-vif-plugged", "status": "completed", "tag": "a98bf10e-b29e-4c77-8249-7c04d7ab12b9", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:40.903222 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-a15fb48a-d349-430b-99cb-ddb0c0ab3d1f {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:40.903607 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9dc0276-9434-487d-a1ac-e95f0c499129', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a98bf10e-b29e-4c77-8249-7c04d7ab12b9', 'code': 200} Nov 21 13:56:40.931553 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=a98bf10e-b29e-4c77-8249-7c04d7ab12b9,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:41.072178 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-169d7186-bcfe-4b36-b2fd-f601c4189123 req-ae96307a-5479-4ab2-84c9-55a18119e7d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:41.073639 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-169d7186-bcfe-4b36-b2fd-f601c4189123 req-ae96307a-5479-4ab2-84c9-55a18119e7d5 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 1098 time: 0.0428858 Nov 21 13:56:41.118037 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-169d7186-bcfe-4b36-b2fd-f601c4189123 req-2cb39696-4a29-4813-b92a-d25d41935ba4 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0359554 Nov 21 13:56:41.275714 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec011f5c-12b9-4743-9f0d-c0403ac578ee req-b0be1b44-9ea8-4429-b2dd-09a94a767a9a tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:41.277232 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ec011f5c-12b9-4743-9f0d-c0403ac578ee req-b0be1b44-9ea8-4429-b2dd-09a94a767a9a tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 945 time: 0.0488052 Nov 21 13:56:41.279539 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec9de7d-967d-4cb8-bf5c-1651387285f1 req-fe1a5120-c845-49ea-bd8e-d1ef5348d67f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:41.281022 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dec9de7d-967d-4cb8-bf5c-1651387285f1 req-fe1a5120-c845-49ea-bd8e-d1ef5348d67f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0484405 Nov 21 13:56:41.325770 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ec011f5c-12b9-4743-9f0d-c0403ac578ee req-662ae476-351b-4e16-9100-dc2fcd1bcf83 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422254 Nov 21 13:56:41.332397 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dec9de7d-967d-4cb8-bf5c-1651387285f1 req-9f6e2b0b-093a-4625-b0d0-ee152399e6bc tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447407 Nov 21 13:56:42.586435 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-022bf072-7979-4192-8ae4-6b7b02c08465 req-add11909-4d32-4e2b-b654-89209772f2d8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:42.587056 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184057e4-5c1d-42a8-aee1-36e6d1f5f173 req-5badc7ff-68d4-4c66-97d8-3408df5fa966 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:42.587921 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-022bf072-7979-4192-8ae4-6b7b02c08465 req-add11909-4d32-4e2b-b654-89209772f2d8 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 945 time: 0.1900108 Nov 21 13:56:42.588557 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-184057e4-5c1d-42a8-aee1-36e6d1f5f173 req-5badc7ff-68d4-4c66-97d8-3408df5fa966 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.1807182 Nov 21 13:56:42.635534 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-022bf072-7979-4192-8ae4-6b7b02c08465 req-804bcde3-acd6-48d3-8478-b7b23f8669b3 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415771 Nov 21 13:56:42.640912 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-184057e4-5c1d-42a8-aee1-36e6d1f5f173 req-0e0b6018-1a3a-4812-8148-2bf03c36e08d tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465469 Nov 21 13:56:43.752634 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb488dbc-0ec7-45ab-a8c2-af0ef1375d95 req-a5417fd0-097b-4594-ae0d-22a6e89de3f5 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:43.754186 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-eb488dbc-0ec7-45ab-a8c2-af0ef1375d95 req-a5417fd0-097b-4594-ae0d-22a6e89de3f5 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 945 time: 0.0500972 Nov 21 13:56:43.760975 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a33dea3d-6f91-46e6-a366-89edfe931bfd req-18215584-9be5-4c26-9825-7b3642abd658 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:43.762489 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a33dea3d-6f91-46e6-a366-89edfe931bfd req-18215584-9be5-4c26-9825-7b3642abd658 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0524724 Nov 21 13:56:43.807189 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-eb488dbc-0ec7-45ab-a8c2-af0ef1375d95 req-3448510d-a453-4585-94eb-a45b199f27bb tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442874 Nov 21 13:56:43.811297 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a33dea3d-6f91-46e6-a366-89edfe931bfd req-b6c6f826-13b9-41bf-ad12-751b3db92ad5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418515 Nov 21 13:56:44.481442 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58028f76-0d7e-4b18-b872-f54c9a4bb7cb req-da462232-4964-497a-9c2c-2a9ff5918509 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:44.482874 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58028f76-0d7e-4b18-b872-f54c9a4bb7cb req-da462232-4964-497a-9c2c-2a9ff5918509 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 945 time: 0.0473857 Nov 21 13:56:44.530706 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58028f76-0d7e-4b18-b872-f54c9a4bb7cb req-83f7f6d9-8a04-4720-b4d6-2ad92bf7e585 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408533 Nov 21 13:56:44.929913 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3496de0-ab55-4cce-b759-fc534ddc4339 req-b8a44070-ed11-4230-af00-3656294f8ffb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:44.931414 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f3496de0-ab55-4cce-b759-fc534ddc4339 req-b8a44070-ed11-4230-af00-3656294f8ffb tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0512390 Nov 21 13:56:44.981961 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f3496de0-ab55-4cce-b759-fc534ddc4339 req-88571661-fcf0-4b2a-9d5f-51b5ad3beefa tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445459 Nov 21 13:56:45.643685 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cf124c1-9141-4e71-80ea-665a00c0908d req-a8892a16-9fff-4cfb-be28-c3d7be1f5945 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:45.645207 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0cf124c1-9141-4e71-80ea-665a00c0908d req-a8892a16-9fff-4cfb-be28-c3d7be1f5945 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 945 time: 0.0475512 Nov 21 13:56:45.691150 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0cf124c1-9141-4e71-80ea-665a00c0908d req-d3ed36c7-a8c7-4abb-9489-4cdf6797939f tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/security-groups?id=31d5f715-2673-48e4-b41c-689a0cb071e0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402017 Nov 21 13:56:46.098819 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e720c715-af8d-4493-a65d-b5aa15959a8d req-b85bda62-053b-4f0d-a595-89b745a5e7b6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:46.100350 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e720c715-af8d-4493-a65d-b5aa15959a8d req-b85bda62-053b-4f0d-a595-89b745a5e7b6 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0476615 Nov 21 13:56:46.135408 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 req-7466bff1-0185-46bf-9b15-5a3cc7802d9c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:46.136885 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 req-7466bff1-0185-46bf-9b15-5a3cc7802d9c tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.50 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 945 time: 0.0531540 Nov 21 13:56:46.155119 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e720c715-af8d-4493-a65d-b5aa15959a8d req-d61016a4-9ee0-4461-afe8-4814db95974f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0488002 Nov 21 13:56:46.231378 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 req-86c263d6-1bd2-419a-b765-3dedd04ad33d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Deleting port a98bf10e-b29e-4c77-8249-7c04d7ab12b9 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:56:46.231729 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 req-86c263d6-1bd2-419a-b765-3dedd04ad33d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:46.324108 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 req-86c263d6-1bd2-419a-b765-3dedd04ad33d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] For port a98bf10e-b29e-4c77-8249-7c04d7ab12b9, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=a98bf10e-b29e-4c77-8249-7c04d7ab12b9,segment=NetworkSegment(ca6a4efb-a4da-49cc-b95f-38efaa9bc82c),segment_id=ca6a4efb-a4da-49cc-b95f-38efaa9bc82c)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:46.324473 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 req-86c263d6-1bd2-419a-b765-3dedd04ad33d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:46.337120 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 req-86c263d6-1bd2-419a-b765-3dedd04ad33d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Calling delete_port for a98bf10e-b29e-4c77-8249-7c04d7ab12b9 owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:56:46.460874 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 req-86c263d6-1bd2-419a-b765-3dedd04ad33d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:46.474452 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['a98bf10e-b29e-4c77-8249-7c04d7ab12b9'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:56:46.488952 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86c263d6-1bd2-419a-b765-3dedd04ad33d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Pushing event deleted for resources: {'Port': ['ID=a98bf10e-b29e-4c77-8249-7c04d7ab12b9,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:46.528241 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 req-86c263d6-1bd2-419a-b765-3dedd04ad33d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] No DVR routers for this DVR port a98bf10e-b29e-4c77-8249-7c04d7ab12b9 on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:56:46.530727 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 req-86c263d6-1bd2-419a-b765-3dedd04ad33d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:46.534105 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c186cd2a-774b-45f8-a91e-f41ce03bc4c2 req-86c263d6-1bd2-419a-b765-3dedd04ad33d tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.50 "DELETE /v2.0/ports/a98bf10e-b29e-4c77-8249-7c04d7ab12b9 HTTP/1.1" status: 204 len: 173 time: 0.3890576 Nov 21 13:56:46.534540 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9dc0276-9434-487d-a1ac-e95f0c499129', 'name': 'network-vif-deleted', 'tag': 'a98bf10e-b29e-4c77-8249-7c04d7ab12b9'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:46.536787 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-685343f3-2626-4f8a-b789-bd700da8c98b" -d '{"events": [{"server_uuid": "e9dc0276-9434-487d-a1ac-e95f0c499129", "name": "network-vif-deleted", "tag": "a98bf10e-b29e-4c77-8249-7c04d7ab12b9"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:46.575692 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ceb9a76f-ded7-433b-ada5-6a47622b5797 x-openstack-request-id: req-ceb9a76f-ded7-433b-ada5-6a47622b5797 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:46.576348 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e9dc0276-9434-487d-a1ac-e95f0c499129", "name": "network-vif-deleted", "tag": "a98bf10e-b29e-4c77-8249-7c04d7ab12b9", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:46.576348 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-ceb9a76f-ded7-433b-ada5-6a47622b5797 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:46.576658 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9dc0276-9434-487d-a1ac-e95f0c499129', 'name': 'network-vif-deleted', 'tag': 'a98bf10e-b29e-4c77-8249-7c04d7ab12b9', 'status': 'completed', 'code': 200} Nov 21 13:56:46.796668 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-305bd711-41e4-4eee-b7f4-b43e12aa45c4 req-8cdaa38e-8048-4e32-9bf2-fab336915b20 tempest-VolumesActionsTest-695662200 tempest-VolumesActionsTest-695662200-project] 10.222.0.11 "GET /v2.0/ports?device_id=e9dc0276-9434-487d-a1ac-e95f0c499129 HTTP/1.1" status: 200 len: 210 time: 0.0256593 Nov 21 13:56:47.271823 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ff6796-e947-433d-b2d5-46ade5bc69ec req-1f2e50d2-d521-4152-b732-e3fb27524868 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:47.273309 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40ff6796-e947-433d-b2d5-46ade5bc69ec req-1f2e50d2-d521-4152-b732-e3fb27524868 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0511432 Nov 21 13:56:47.322168 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40ff6796-e947-433d-b2d5-46ade5bc69ec req-4617d249-68fe-4676-a5c5-3bed41da5569 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428388 Nov 21 13:56:47.958011 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5499815d-d064-4343-a883-fb1599f10230 req-7c57a1a0-f101-4d6f-81a1-3e66014005d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:47.959503 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5499815d-d064-4343-a883-fb1599f10230 req-7c57a1a0-f101-4d6f-81a1-3e66014005d2 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3f91d0ec3fb5421aa1fb95a0cb0d040d&device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 1099 time: 0.0436206 Nov 21 13:56:48.055344 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5499815d-d064-4343-a883-fb1599f10230 req-0a2fe53f-7fff-4a19-a9ae-009bb839ad27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:48.057112 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5499815d-d064-4343-a883-fb1599f10230 req-0a2fe53f-7fff-4a19-a9ae-009bb839ad27 service neutron] 10.222.0.50 "GET /v2.0/networks?id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f HTTP/1.1" status: 200 len: 910 time: 0.0877016 Nov 21 13:56:48.127132 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5499815d-d064-4343-a883-fb1599f10230 req-b07eb500-81a4-4837-99ee-d96f4ada8717 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a HTTP/1.1" status: 200 len: 1001 time: 0.0576966 Nov 21 13:56:48.188578 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5499815d-d064-4343-a883-fb1599f10230 req-02da268a-206f-49f6-9bd8-0696a1e5eab6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:48.188578 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5499815d-d064-4343-a883-fb1599f10230 req-02da268a-206f-49f6-9bd8-0696a1e5eab6 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=10eb4393-a8dc-4fd9-855e-e410045be9e3 HTTP/1.1" status: 200 len: 848 time: 0.0539799 Nov 21 13:56:48.238755 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5499815d-d064-4343-a883-fb1599f10230 req-8b7c72a0-9c9b-4595-a93e-eeb04dac7a9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:48.240527 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5499815d-d064-4343-a883-fb1599f10230 req-8b7c72a0-9c9b-4595-a93e-eeb04dac7a9b service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0444686 Nov 21 13:56:48.333260 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5499815d-d064-4343-a883-fb1599f10230 req-195675b5-f715-44c0-83d4-dfe880eae9e5 service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840163 Nov 21 13:56:48.479118 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ff18e8-812c-4371-bcd3-7c98a1f96b5f req-a656e859-4ad0-4b76-a959-bfd2d4303dde tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:48.480612 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-97ff18e8-812c-4371-bcd3-7c98a1f96b5f req-a656e859-4ad0-4b76-a959-bfd2d4303dde tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0769470 Nov 21 13:56:48.484179 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5499815d-d064-4343-a883-fb1599f10230 req-51f4521e-94cc-4e3c-a314-67692c0fdddd service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1371531 Nov 21 13:56:48.538019 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-97ff18e8-812c-4371-bcd3-7c98a1f96b5f req-091d4e11-a2f8-4ad5-ae72-eb574a6a92f1 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0506797 Nov 21 13:56:51.610496 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device a98bf10e-b29e-4c77-8249-7c04d7ab12b9 no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:56:51.630601 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: a98bf10e-b29e-4c77-8249-7c04d7ab12b9 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:56:51.631037 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device a98bf10e-b29e-4c77-8249-7c04d7ab12b9 not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:56:51.744144 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578e7ad4-9c2b-4462-9881-2a8f4b3aab5a req-736f6e53-55ec-41d0-8901-30cc09fad6c7 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:51.745612 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-578e7ad4-9c2b-4462-9881-2a8f4b3aab5a req-736f6e53-55ec-41d0-8901-30cc09fad6c7 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0510089 Nov 21 13:56:51.797006 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-578e7ad4-9c2b-4462-9881-2a8f4b3aab5a req-856ce5a2-c6f6-4f54-9d07-c0f74430f99a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454230 Nov 21 13:56:52.584904 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:52.920155 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-855febc5-d9ed-496f-b0ec-62a1e9db8db5 req-01683787-ce3d-46a9-8139-65a2c112673c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:52.921755 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-855febc5-d9ed-496f-b0ec-62a1e9db8db5 req-01683787-ce3d-46a9-8139-65a2c112673c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0491335 Nov 21 13:56:52.924641 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c426aa-3adc-47a3-97c1-6b578d89e9d3 req-b0a51709-6b2f-4e69-bd4e-620603594ca5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:52.926398 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c426aa-3adc-47a3-97c1-6b578d89e9d3 req-b0a51709-6b2f-4e69-bd4e-620603594ca5 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3f91d0ec3fb5421aa1fb95a0cb0d040d&device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 1099 time: 0.0623262 Nov 21 13:56:52.980604 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-855febc5-d9ed-496f-b0ec-62a1e9db8db5 req-36d22099-7730-476f-b2ef-bff212f37d89 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497510 Nov 21 13:56:53.045889 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c426aa-3adc-47a3-97c1-6b578d89e9d3 req-7601a187-4d2f-4e08-b801-3afffe0b1e89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:53.047358 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c426aa-3adc-47a3-97c1-6b578d89e9d3 req-7601a187-4d2f-4e08-b801-3afffe0b1e89 service neutron] 10.222.0.50 "GET /v2.0/networks?id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f HTTP/1.1" status: 200 len: 910 time: 0.0979669 Nov 21 13:56:53.139754 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c426aa-3adc-47a3-97c1-6b578d89e9d3 req-734708f4-d076-47fb-9ca3-9c4f8e323179 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a HTTP/1.1" status: 200 len: 1001 time: 0.0795972 Nov 21 13:56:53.209455 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c426aa-3adc-47a3-97c1-6b578d89e9d3 req-9b30c237-63a7-4122-8061-91268a60f719 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:53.211546 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c426aa-3adc-47a3-97c1-6b578d89e9d3 req-9b30c237-63a7-4122-8061-91268a60f719 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=10eb4393-a8dc-4fd9-855e-e410045be9e3 HTTP/1.1" status: 200 len: 848 time: 0.0526848 Nov 21 13:56:53.276205 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c426aa-3adc-47a3-97c1-6b578d89e9d3 req-9be9f9cd-cdaf-4e3a-85e9-30a10be5e37c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:53.278811 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c426aa-3adc-47a3-97c1-6b578d89e9d3 req-9be9f9cd-cdaf-4e3a-85e9-30a10be5e37c service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0550375 Nov 21 13:56:53.385574 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c426aa-3adc-47a3-97c1-6b578d89e9d3 req-16f107b1-2016-464a-9230-b40ad6278a7c service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0957105 Nov 21 13:56:53.507842 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-95c426aa-3adc-47a3-97c1-6b578d89e9d3 req-0e668682-21d5-4944-b14b-bd2e46c420b2 service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1141701 Nov 21 13:56:54.115114 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7b9fd4-bffb-4794-a866-6580ae678469 req-a5f830fc-7907-426c-bec2-9bafd6f0e0b9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:54.117345 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-da7b9fd4-bffb-4794-a866-6580ae678469 req-a5f830fc-7907-426c-bec2-9bafd6f0e0b9 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0600502 Nov 21 13:56:54.171059 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-da7b9fd4-bffb-4794-a866-6580ae678469 req-36acfea7-a519-4cba-8435-714461b5f5d2 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451245 Nov 21 13:56:54.259010 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [req-bb947e24-1b30-44e7-9c1a-81dc6fff4480 req-06327ba5-ae96-4a98-9fb9-bfd7dea21473 service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109041) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 13:56:54.260066 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bb947e24-1b30-44e7-9c1a-81dc6fff4480 req-06327ba5-ae96-4a98-9fb9-bfd7dea21473 service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0071099 Nov 21 13:56:54.450870 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-56aadef4-b93b-4234-bfdb-8a3a33c1b922 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0769837 Nov 21 13:56:54.471703 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e650610b-4a50-4bce-8740-190ca9f8fefb req-8de5a07f-492d-4f25-af98-bdb449554640 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:54.473489 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e650610b-4a50-4bce-8740-190ca9f8fefb req-8de5a07f-492d-4f25-af98-bdb449554640 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0620089 Nov 21 13:56:54.530380 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e650610b-4a50-4bce-8740-190ca9f8fefb req-68214960-0c2b-4008-9b3c-bf87b5147636 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453525 Nov 21 13:56:55.716433 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1303e674-da9e-439a-a012-45e5c464f11f req-92fed62a-7324-4ff0-9cc5-8f824704dc22 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:55.724129 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1303e674-da9e-439a-a012-45e5c464f11f req-92fed62a-7324-4ff0-9cc5-8f824704dc22 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0743947 Nov 21 13:56:55.791314 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1303e674-da9e-439a-a012-45e5c464f11f req-4e392a94-349d-4be3-8505-c984f83c384a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0661409 Nov 21 13:56:56.328192 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-03171803-f638-43a9-addb-5ead04039df1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:56.328858 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-03171803-f638-43a9-addb-5ead04039df1 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06&tenant_id=3f91d0ec3fb5421aa1fb95a0cb0d040d HTTP/1.1" status: 200 len: 1099 time: 0.0479581 Nov 21 13:56:56.401521 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-bb55ab7b-8cf7-4c88-b309-12600773889b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:56.403439 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-bb55ab7b-8cf7-4c88-b309-12600773889b service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3f91d0ec3fb5421aa1fb95a0cb0d040d&device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 1099 time: 0.0462213 Nov 21 13:56:56.514966 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-3b6622dd-7536-48e6-b51a-4f1b4565eb10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:56.516915 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-3b6622dd-7536-48e6-b51a-4f1b4565eb10 service neutron] 10.222.0.50 "GET /v2.0/networks?id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f HTTP/1.1" status: 200 len: 910 time: 0.1043475 Nov 21 13:56:56.587348 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-5afbd2ec-9310-48b1-850d-9a92f49f752c service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a HTTP/1.1" status: 200 len: 1001 time: 0.0608432 Nov 21 13:56:56.641315 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-adb76b85-45fd-4496-a895-fa507355cba2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:56.643057 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-adb76b85-45fd-4496-a895-fa507355cba2 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=10eb4393-a8dc-4fd9-855e-e410045be9e3 HTTP/1.1" status: 200 len: 848 time: 0.0470705 Nov 21 13:56:56.708733 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-c1800065-7db3-4bc4-aa63-c8578ca1567a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:56.710351 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-c1800065-7db3-4bc4-aa63-c8578ca1567a service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0510130 Nov 21 13:56:56.797229 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 5907d47d-9ae0-44a4-adf8-9e5e784f851a no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:56:56.840429 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-f5f6bbed-8d4b-4fbf-91e6-f40fe82d8e6c service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1183043 Nov 21 13:56:56.972212 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-bbbd22ae-fbf8-48e7-84c7-4f0b0f3276f8 service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1214943 Nov 21 13:56:56.983389 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:56.996022 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-173e9062-fa54-483b-a4cd-3ad3832b6c46 req-1fd0dc08-0745-47ff-8aa2-48c1d72e0018 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:57.004630 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-173e9062-fa54-483b-a4cd-3ad3832b6c46 req-1fd0dc08-0745-47ff-8aa2-48c1d72e0018 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0846286 Nov 21 13:56:57.030899 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 5907d47d-9ae0-44a4-adf8-9e5e784f851a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:56:57.033231 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:56:57.038220 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c3d0df36-aeac-4699-8d19-0469b7b64b07" -d '{"events": [{"server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "name": "network-vif-unplugged", "status": "completed", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:56:57.042846 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:56:57.085855 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-173e9062-fa54-483b-a4cd-3ad3832b6c46 req-50475598-6372-4cb9-bb11-306e555f9175 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0799911 Nov 21 13:56:57.105569 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Sun, 21 Nov 2021 13:56:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-24f8f363-4d52-4c3d-ac03-04f438c27e1d x-openstack-request-id: req-24f8f363-4d52-4c3d-ac03-04f438c27e1d {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:56:57.106111 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "name": "network-vif-unplugged", "status": "completed", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:56:57.106531 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-24f8f363-4d52-4c3d-ac03-04f438c27e1d {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:56:57.107110 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'code': 200} Nov 21 13:56:57.112747 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=5907d47d-9ae0-44a4-adf8-9e5e784f851a,revision_number=6']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:56:58.246312 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0c87056-9b2a-45d3-a874-355b767c6bfb req-4264c9aa-ca18-4f3b-a45a-8c4c1520b758 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:58.247902 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d0c87056-9b2a-45d3-a874-355b767c6bfb req-4264c9aa-ca18-4f3b-a45a-8c4c1520b758 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0559263 Nov 21 13:56:58.310982 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d0c87056-9b2a-45d3-a874-355b767c6bfb req-64dd14ec-154c-4217-ab18-63fefefccaef tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535762 Nov 21 13:56:59.437608 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b3ba7dd-1886-4acd-b838-bb99ecf013dc req-ecd36a71-345d-4d15-b936-ec1d1a52e13c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:56:59.439121 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3b3ba7dd-1886-4acd-b838-bb99ecf013dc req-ecd36a71-345d-4d15-b936-ec1d1a52e13c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0512111 Nov 21 13:56:59.494078 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3b3ba7dd-1886-4acd-b838-bb99ecf013dc req-b10fa870-e750-4c53-b1c1-fecf87ac1eee tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480180 Nov 21 13:57:00.175431 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-31ed71f0-788e-4fd5-9679-2746fdae542a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:00.622355 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e32c79d-d93f-4cbf-83ff-6bd9fb323ea6 req-151584ad-8caf-49e3-9956-fcf25de96958 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:00.624042 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4e32c79d-d93f-4cbf-83ff-6bd9fb323ea6 req-151584ad-8caf-49e3-9956-fcf25de96958 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0504098 Nov 21 13:57:00.694444 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4e32c79d-d93f-4cbf-83ff-6bd9fb323ea6 req-8c5fc525-6df0-40e9-93ab-b1f090610777 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571043 Nov 21 13:57:01.814496 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8de9555b-b626-4512-94cc-1a4037173017 req-1dcdc31a-065a-441c-b46a-950c8de6d9d5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:01.816130 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8de9555b-b626-4512-94cc-1a4037173017 req-1dcdc31a-065a-441c-b46a-950c8de6d9d5 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0571110 Nov 21 13:57:01.917120 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8de9555b-b626-4512-94cc-1a4037173017 req-52897997-b928-4d0c-b448-e95a47681fbf tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0937970 Nov 21 13:57:02.572659 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c8cd559d-32df-4348-8637-6a0894195506 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:03.052380 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96003ad-e1fc-4801-b83e-bbefad9d905a req-bb01835b-6f05-4ecc-ab1f-986b58d143a7 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:03.054489 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f96003ad-e1fc-4801-b83e-bbefad9d905a req-bb01835b-6f05-4ecc-ab1f-986b58d143a7 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0617986 Nov 21 13:57:03.121359 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f96003ad-e1fc-4801-b83e-bbefad9d905a req-b3a06640-1c37-4139-8fbb-10bf166b38df tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0575428 Nov 21 13:57:03.474247 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb1a9e0a-dbe9-4a5b-b628-796480ff8958 req-10b3beff-2aa5-4b20-9ce8-4b331d0ff14c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:03.475863 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bb1a9e0a-dbe9-4a5b-b628-796480ff8958 req-10b3beff-2aa5-4b20-9ce8-4b331d0ff14c service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 1097 time: 0.0980928 Nov 21 13:57:03.541255 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bb1a9e0a-dbe9-4a5b-b628-796480ff8958 req-cbdceef2-a5c6-49ac-ba6c-27e4c1330082 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0557981 Nov 21 13:57:03.851552 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25a90334-bd0f-4282-90ac-b94943d0a9c0 req-e2a6ebce-fd6f-4295-8165-bb9d5e1b947d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:03.853065 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-25a90334-bd0f-4282-90ac-b94943d0a9c0 req-e2a6ebce-fd6f-4295-8165-bb9d5e1b947d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0578825 Nov 21 13:57:03.889382 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:03.917942 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-25a90334-bd0f-4282-90ac-b94943d0a9c0 req-401b0844-7581-4cad-86b1-8a73bf1e9f6c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0580664 Nov 21 13:57:04.243446 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0e0c3c-9982-43e9-8baf-8ba4cd7c3c84 req-28a45e30-fb9f-4a18-85e1-9953d5e8bb05 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:04.244913 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ff0e0c3c-9982-43e9-8baf-8ba4cd7c3c84 req-28a45e30-fb9f-4a18-85e1-9953d5e8bb05 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 944 time: 0.0508401 Nov 21 13:57:04.307743 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ff0e0c3c-9982-43e9-8baf-8ba4cd7c3c84 req-827aa944-693b-4f66-80df-86aef097db9a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0559542 Nov 21 13:57:04.826904 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 5907d47d-9ae0-44a4-adf8-9e5e784f851a details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:57:04.952828 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 5907d47d-9ae0-44a4-adf8-9e5e784f851a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:04.973593 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'port_id': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'mac_address': 'fa:16:3e:d6:83:35', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 515, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:57:05.019311 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:05.033358 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5907d47d-9ae0-44a4-adf8-9e5e784f851a {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:57:05.071851 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 5907d47d-9ae0-44a4-adf8-9e5e784f851a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:05.077260 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:05.083613 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:05.095353 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7bfbf36-b8ef-453b-a648-0f2f9a2cf16d req-4b5c763c-2be4-49b2-b65a-7b022be33b36 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:05.096997 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d7bfbf36-b8ef-453b-a648-0f2f9a2cf16d req-4b5c763c-2be4-49b2-b65a-7b022be33b36 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0708182 Nov 21 13:57:05.148248 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=5907d47d-9ae0-44a4-adf8-9e5e784f851a,revision_number=7']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:05.170125 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d7bfbf36-b8ef-453b-a648-0f2f9a2cf16d req-20b2a370-4b1c-458b-8f43-ee5d5906b7fa tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0657964 Nov 21 13:57:05.379180 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['5907d47d-9ae0-44a4-adf8-9e5e784f851a'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:57:05.445243 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e0358eb-833c-4217-beba-de1ca4022165 req-dc8e0f8e-e165-4425-a8b6-0192e96bf8b4 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:05.453130 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1e0358eb-833c-4217-beba-de1ca4022165 req-dc8e0f8e-e165-4425-a8b6-0192e96bf8b4 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 945 time: 0.0667753 Nov 21 13:57:05.501473 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1e0358eb-833c-4217-beba-de1ca4022165 req-ea1b5d61-3312-4a7d-81db-a8ad292e8547 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469420 Nov 21 13:57:05.856764 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:06.311973 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f72f396-fa6e-46b8-870f-9d385c5e304b req-22116dea-7da5-4cf1-be49-72b97d2b09d0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:06.319029 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-9f72f396-fa6e-46b8-870f-9d385c5e304b req-22116dea-7da5-4cf1-be49-72b97d2b09d0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0614357 Nov 21 13:57:06.366536 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-9f72f396-fa6e-46b8-870f-9d385c5e304b req-4b79d284-3932-436f-9a87-0c95c80f0f22 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465724 Nov 21 13:57:06.847233 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 5907d47d-9ae0-44a4-adf8-9e5e784f851a up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:57:06.904514 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 5907d47d-9ae0-44a4-adf8-9e5e784f851a triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:57:06.904884 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:06.986482 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:07.018159 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:57:07.020567 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-269f0972-39eb-4e3d-b0b0-ef915f96271a" -d '{"events": [{"server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "name": "network-vif-plugged", "status": "completed", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:57:07.036901 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 5907d47d-9ae0-44a4-adf8-9e5e784f851a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:07.042128 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:07.081749 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:57:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d5e9ea0c-eb64-48c4-9958-440307b59aee x-openstack-request-id: req-d5e9ea0c-eb64-48c4-9958-440307b59aee {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:57:07.082258 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "name": "network-vif-plugged", "status": "completed", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:57:07.082595 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-d5e9ea0c-eb64-48c4-9958-440307b59aee {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:57:07.084100 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'code': 200} Nov 21 13:57:07.111411 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=5907d47d-9ae0-44a4-adf8-9e5e784f851a,revision_number=8']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:07.505566 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd8354a6-343c-4408-a05d-ede33dc6d713 req-46d3924d-dcf5-4b95-a93b-0080f323ea39 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:07.507210 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fd8354a6-343c-4408-a05d-ede33dc6d713 req-46d3924d-dcf5-4b95-a93b-0080f323ea39 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0603442 Nov 21 13:57:07.556595 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fd8354a6-343c-4408-a05d-ede33dc6d713 req-5de4f826-ced4-45b4-8bec-54a8e724949e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431495 Nov 21 13:57:08.685902 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-832ad370-5dc3-43ae-88fb-ace7ecba9b5c req-e760c021-10df-4cc5-989b-991ebda49f15 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:08.687428 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-832ad370-5dc3-43ae-88fb-ace7ecba9b5c req-e760c021-10df-4cc5-989b-991ebda49f15 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0505145 Nov 21 13:57:08.736980 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-832ad370-5dc3-43ae-88fb-ace7ecba9b5c req-b4959858-7f78-4a19-b324-afc044861ea7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433140 Nov 21 13:57:09.855208 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb771679-77df-4524-bed5-e0c0911781e6 req-8c242440-b72a-4253-82da-ea2b1441c97d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:09.856703 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bb771679-77df-4524-bed5-e0c0911781e6 req-8c242440-b72a-4253-82da-ea2b1441c97d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0488687 Nov 21 13:57:09.911683 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bb771679-77df-4524-bed5-e0c0911781e6 req-d980c3f6-41e1-4c81-a48f-0c3a350946b0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469069 Nov 21 13:57:10.664132 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 56470) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:10.707791 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_v2 [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Deleting subnet d8009172-70e4-41f9-97b4-16c142689002 {{(pid=109041) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 13:57:10.710906 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:10.745045 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4028984'] for subnet, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:10.782449 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:10.835109 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3086848', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261005199'] for subnet, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:10.857732 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d8009172-70e4-41f9-97b4-16c142689002,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:10.867774 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:10.868151 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:10.868496 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:10.868830 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:10.869166 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:10.869498 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:10.869830 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:10.870684 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:10.870684 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:10.870908 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:10.871092 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:10.871414 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:10.874167 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:10.879865 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-da0cb437-6ad1-422b-ba0f-29e8e71a4d00 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/d8009172-70e4-41f9-97b4-16c142689002 HTTP/1.1" status: 204 len: 168 time: 0.2146747 Nov 21 13:57:10.880178 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 56474) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:10.949783 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:11.027845 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:11.033430 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f8028b-adf7-4afa-a624-6952b8608451 req-1bb0a20a-3cbd-4833-bf2a-3df32ab79a9b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:11.034935 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c5f8028b-adf7-4afa-a624-6952b8608451 req-1bb0a20a-3cbd-4833-bf2a-3df32ab79a9b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0512421 Nov 21 13:57:11.049058 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['79b4766e-abe9-40ee-bfd9-f2f24b2ae559']}} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:11.058199 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ca6a4efb-a4da-49cc-b95f-38efaa9bc82c') {'for_net_delete': True} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:11.058502 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ca6a4efb-a4da-49cc-b95f-38efaa9bc82c') {} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:11.071831 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-261998924'] for segment, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:11.081319 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c5f8028b-adf7-4afa-a624-6952b8608451 req-e57cf70c-eb75-4021-9c5c-3cd8bea3d1b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402458 Nov 21 13:57:11.085125 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:11.091011 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Releasing vlan 510 on physical network physnet1 to pool {{(pid=109040) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 13:57:11.091393 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2298122'] for segment, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: Traceback (most recent call last): Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: timer() Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: cb(*args, **kw) Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: return func(*args, **kwargs) Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: self._notify() Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: self.callback(batched_events) Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: event.method(event) Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: return f(self, *a, **k) Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._get(url).json() Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: return self.request(url, 'GET', **kwargs) Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 13:57:11.093061 dv-cinder-768458-12-iscsi neutron-server[109040]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 13:57:11.145289 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:11.150407 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:11.153577 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] 10.222.0.11 "DELETE /v2.0/networks/79b4766e-abe9-40ee-bfd9-f2f24b2ae559 HTTP/1.1" status: 204 len: 168 time: 0.2723916 Nov 21 13:57:11.164588 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Pushing event deleted for resources: {'Network': ['ID=79b4766e-abe9-40ee-bfd9-f2f24b2ae559,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:11.171590 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:11.171974 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:11.172350 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:11.172689 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:11.173022 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:11.173356 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:11.173693 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:11.174025 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:11.174356 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:11.174685 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:11.175010 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:11.175332 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a9a4e09-f26c-4f7b-bf9a-fbb9f66fac7a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:11.261714 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 56480) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:11.301008 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-6211c93d-a2be-4ef5-8297-99a5e4316b84 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=017390dd50484d0bb3cf04f97f3cfdb9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0381541 Nov 21 13:57:11.303340 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 56482) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:11.349254 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e846bb13-1319-4a34-aa83-211a988b8b97 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:11.369276 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e846bb13-1319-4a34-aa83-211a988b8b97 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:11.417513 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e846bb13-1319-4a34-aa83-211a988b8b97 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:11.420190 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e846bb13-1319-4a34-aa83-211a988b8b97 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:11.421336 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-e846bb13-1319-4a34-aa83-211a988b8b97 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/31d5f715-2673-48e4-b41c-689a0cb071e0 HTTP/1.1" status: 204 len: 168 time: 0.1171062 Nov 21 13:57:11.429173 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e846bb13-1319-4a34-aa83-211a988b8b97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=31d5f715-2673-48e4-b41c-689a0cb071e0,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:12.201472 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-936801e5-b6b3-4227-8605-af5dec2b0be4 req-3dd74946-fc04-41ea-beeb-ee2ac59bf9ec tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:12.202823 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-936801e5-b6b3-4227-8605-af5dec2b0be4 req-3dd74946-fc04-41ea-beeb-ee2ac59bf9ec tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0470748 Nov 21 13:57:12.252366 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-936801e5-b6b3-4227-8605-af5dec2b0be4 req-32a238fa-d54d-4b95-a0d1-1056006d988e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436733 Nov 21 13:57:13.367468 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc8b4fba-21bb-4cf5-8144-6c18492892c6 req-2ae1df93-d0af-4cc0-b1d6-831d65705db6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:13.368940 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-cc8b4fba-21bb-4cf5-8144-6c18492892c6 req-2ae1df93-d0af-4cc0-b1d6-831d65705db6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0468671 Nov 21 13:57:13.415508 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-cc8b4fba-21bb-4cf5-8144-6c18492892c6 req-cbc364f3-77df-4985-a37a-ea9ffaf5f289 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405533 Nov 21 13:57:14.530887 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb1b387b-aa2d-4004-aa04-735cb376c286 req-4ace1e57-ef13-48ce-9f7d-67a942f41526 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:14.532837 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fb1b387b-aa2d-4004-aa04-735cb376c286 req-4ace1e57-ef13-48ce-9f7d-67a942f41526 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0470083 Nov 21 13:57:14.578833 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-fb1b387b-aa2d-4004-aa04-735cb376c286 req-289d8671-3169-4e0d-a0ea-2d0d776707f1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400491 Nov 21 13:57:15.698583 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab4f3057-e5fc-4368-bc4a-9469893653e7 req-2c7b3414-abef-4438-b448-1b79b6c4f56d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:15.700106 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ab4f3057-e5fc-4368-bc4a-9469893653e7 req-2c7b3414-abef-4438-b448-1b79b6c4f56d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0498338 Nov 21 13:57:15.745756 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ab4f3057-e5fc-4368-bc4a-9469893653e7 req-f94ab166-f7c1-423b-a93b-9f162273b141 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394287 Nov 21 13:57:16.613989 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:57:16.862677 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11e5b47-b843-4141-ab99-5a5981389d6c req-f9dfca1f-0bf6-4830-a1d9-1cd9ad4c4339 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:16.864189 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a11e5b47-b843-4141-ab99-5a5981389d6c req-f9dfca1f-0bf6-4830-a1d9-1cd9ad4c4339 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0471599 Nov 21 13:57:16.910423 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a11e5b47-b843-4141-ab99-5a5981389d6c req-350dc633-269b-4711-a856-12942b32d6cc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405879 Nov 21 13:57:18.027023 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e1e96c-aefd-4693-bc0a-549e8c833133 req-8f179194-62f8-4cd0-87cc-1c416c951f12 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:18.028662 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-48e1e96c-aefd-4693-bc0a-549e8c833133 req-8f179194-62f8-4cd0-87cc-1c416c951f12 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0479951 Nov 21 13:57:18.078118 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-48e1e96c-aefd-4693-bc0a-549e8c833133 req-116cb909-e00f-45f3-a523-d8ed356bcf2c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436361 Nov 21 13:57:19.194643 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964c4e5d-7772-4924-b39d-6084ab855d25 req-782caf59-5446-4c2e-add8-376611382c68 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:19.196098 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-964c4e5d-7772-4924-b39d-6084ab855d25 req-782caf59-5446-4c2e-add8-376611382c68 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0469601 Nov 21 13:57:19.243005 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-964c4e5d-7772-4924-b39d-6084ab855d25 req-835673ff-1c4d-4d33-b37f-b664d6ae1bec tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410585 Nov 21 13:57:20.362541 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a83c4258-694d-4f3f-8d9a-8c4048dcc736 req-9c90f4b1-ea16-4852-81cd-962782c31fcc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:20.364053 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a83c4258-694d-4f3f-8d9a-8c4048dcc736 req-9c90f4b1-ea16-4852-81cd-962782c31fcc tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0484304 Nov 21 13:57:20.411330 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a83c4258-694d-4f3f-8d9a-8c4048dcc736 req-e0e53c70-a838-461a-807d-3185cc053547 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414591 Nov 21 13:57:20.877779 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 73851145-2483-4c28-bf3b-f049e97c28cc details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:57:20.966803 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 73851145-2483-4c28-bf3b-f049e97c28cc, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=73851145-2483-4c28-bf3b-f049e97c28cc,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:20.977787 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '73851145-2483-4c28-bf3b-f049e97c28cc', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'port_id': '73851145-2483-4c28-bf3b-f049e97c28cc', 'mac_address': 'fa:16:3e:e1:6b:20', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 524, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:57:21.013372 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:21.028312 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 73851145-2483-4c28-bf3b-f049e97c28cc {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:57:21.046137 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 73851145-2483-4c28-bf3b-f049e97c28cc, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=73851145-2483-4c28-bf3b-f049e97c28cc,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:21.050764 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:21.096296 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=73851145-2483-4c28-bf3b-f049e97c28cc,revision_number=6']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:21.183254 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['73851145-2483-4c28-bf3b-f049e97c28cc'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:57:21.530680 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe01102-3919-443a-9ab1-0c277a9bb878 req-58d68277-b093-45a9-9a2f-12b48ad2fb65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:21.532697 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ffe01102-3919-443a-9ab1-0c277a9bb878 req-58d68277-b093-45a9-9a2f-12b48ad2fb65 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 944 time: 0.0512831 Nov 21 13:57:21.581298 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ffe01102-3919-443a-9ab1-0c277a9bb878 req-1d5ee6cd-e154-41e5-8f68-6999fbbbfe51 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424151 Nov 21 13:57:22.583175 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:22.714652 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e5e94c-2f4d-4845-baf3-62d7199aaa9c req-f94526cb-1647-4e41-bdf2-405b5ae70c78 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:22.716164 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f9e5e94c-2f4d-4845-baf3-62d7199aaa9c req-f94526cb-1647-4e41-bdf2-405b5ae70c78 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 944 time: 0.0540645 Nov 21 13:57:22.780576 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f9e5e94c-2f4d-4845-baf3-62d7199aaa9c req-00a59e8a-898e-410a-8098-c212d978a5b4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571277 Nov 21 13:57:22.892865 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 73851145-2483-4c28-bf3b-f049e97c28cc up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:57:22.943788 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 73851145-2483-4c28-bf3b-f049e97c28cc triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:57:22.944425 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:23.037064 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:23.065795 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:57:23.070488 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b82634ce-6a0a-4c1f-a38a-da4b563aecce" -d '{"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-plugged", "status": "completed", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:57:23.090031 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 73851145-2483-4c28-bf3b-f049e97c28cc, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=73851145-2483-4c28-bf3b-f049e97c28cc,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:23.098792 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:23.183551 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=73851145-2483-4c28-bf3b-f049e97c28cc,revision_number=7']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:23.317679 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:57:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d3d7d19d-72e0-4882-8fcc-35960014fea1 x-openstack-request-id: req-d3d7d19d-72e0-4882-8fcc-35960014fea1 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:57:23.318005 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-plugged", "status": "completed", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:57:23.318330 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-d3d7d19d-72e0-4882-8fcc-35960014fea1 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:57:23.318745 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc', 'code': 200} Nov 21 13:57:23.907123 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45d89654-2f06-4900-9816-727c9d07dc20 req-c73ace8c-7651-40b8-8e86-f686c4e089ae tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:23.908689 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-45d89654-2f06-4900-9816-727c9d07dc20 req-c73ace8c-7651-40b8-8e86-f686c4e089ae tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0566046 Nov 21 13:57:23.961358 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-45d89654-2f06-4900-9816-727c9d07dc20 req-8fd3dc77-61b0-46f3-a34f-98e59c4eff95 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457127 Nov 21 13:57:25.091949 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc679dd-da54-4ce4-ab5a-b142090a9456 req-2426293e-cf8b-4de2-83db-79c07c7c95f1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:25.093326 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4fc679dd-da54-4ce4-ab5a-b142090a9456 req-2426293e-cf8b-4de2-83db-79c07c7c95f1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0543876 Nov 21 13:57:25.157428 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4fc679dd-da54-4ce4-ab5a-b142090a9456 req-cae7c534-6ffa-4c53-acf4-130dd7a3937a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0546775 Nov 21 13:57:26.298950 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a78b4187-14b5-45e5-937d-65308ec4c5bb req-2a52d441-69aa-41ca-a082-33a42925460d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:26.304583 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a78b4187-14b5-45e5-937d-65308ec4c5bb req-2a52d441-69aa-41ca-a082-33a42925460d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0624130 Nov 21 13:57:26.355186 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a78b4187-14b5-45e5-937d-65308ec4c5bb req-8d03444e-d430-4633-bad0-e4a0c9039a3d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457823 Nov 21 13:57:27.494588 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ed87312-d83e-4a01-87bd-2894026e02ef req-5251f7c8-85ac-49c4-9ddf-df67fd39648a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:27.496545 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7ed87312-d83e-4a01-87bd-2894026e02ef req-5251f7c8-85ac-49c4-9ddf-df67fd39648a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0522854 Nov 21 13:57:27.555873 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7ed87312-d83e-4a01-87bd-2894026e02ef req-499fcf13-eb1a-44f7-895c-784e967af4d7 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0512156 Nov 21 13:57:28.686830 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12e97e50-f146-4e61-b987-e77e21df02a9 req-23c10cb9-b42f-47f1-b20e-be3c8dffffc8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:28.688920 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-12e97e50-f146-4e61-b987-e77e21df02a9 req-23c10cb9-b42f-47f1-b20e-be3c8dffffc8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0507455 Nov 21 13:57:28.742723 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-12e97e50-f146-4e61-b987-e77e21df02a9 req-fd00ecde-1d89-4e8b-a7c6-3f1a49403e8a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471303 Nov 21 13:57:29.880779 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3251f610-a40a-447f-b47e-768efc27d0e7 req-ca145d2e-d042-4c2a-9c83-7de6a6193daf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:29.882420 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3251f610-a40a-447f-b47e-768efc27d0e7 req-ca145d2e-d042-4c2a-9c83-7de6a6193daf tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0507202 Nov 21 13:57:29.943413 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3251f610-a40a-447f-b47e-768efc27d0e7 req-9abc7af9-9a5c-470b-985b-6ec9c8733c26 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0546868 Nov 21 13:57:30.207325 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-20954798-887e-4275-adae-056713c6253f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:31.070950 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b15c83a-6b8f-4d06-96fd-79f26c040d53 req-722ff94f-aeed-4a57-8fd4-c25554419c3b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:31.072396 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4b15c83a-6b8f-4d06-96fd-79f26c040d53 req-722ff94f-aeed-4a57-8fd4-c25554419c3b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0582945 Nov 21 13:57:31.128408 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4b15c83a-6b8f-4d06-96fd-79f26c040d53 req-0796f473-5b74-42d1-a3d1-2e4aa5e48960 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501695 Nov 21 13:57:31.754292 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b61045dc-59c0-4c14-80f6-7e800a02ce1a req-1ddda8a2-faf5-4a86-8bbd-c2d1218a0a76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:31.755658 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b61045dc-59c0-4c14-80f6-7e800a02ce1a req-1ddda8a2-faf5-4a86-8bbd-c2d1218a0a76 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 1098 time: 0.0393736 Nov 21 13:57:31.846120 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b61045dc-59c0-4c14-80f6-7e800a02ce1a req-e4f331d3-9ec9-48a8-8b12-4181bfd71729 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:31.847539 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b61045dc-59c0-4c14-80f6-7e800a02ce1a req-e4f331d3-9ec9-48a8-8b12-4181bfd71729 service neutron] 10.222.0.50 "GET /v2.0/networks?id=24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 200 len: 918 time: 0.0848124 Nov 21 13:57:31.912794 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b61045dc-59c0-4c14-80f6-7e800a02ce1a req-059acac6-ecf7-4cf0-a974-6dcba6ac5ae8 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=73851145-2483-4c28-bf3b-f049e97c28cc HTTP/1.1" status: 200 len: 1001 time: 0.0566916 Nov 21 13:57:31.961893 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b61045dc-59c0-4c14-80f6-7e800a02ce1a req-76b2efe1-e52f-4bf1-885c-3606036aa7d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:31.963260 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b61045dc-59c0-4c14-80f6-7e800a02ce1a req-76b2efe1-e52f-4bf1-885c-3606036aa7d4 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=c4887ea6-9c0e-4a7b-bd51-d70b335ceb92 HTTP/1.1" status: 200 len: 856 time: 0.0416920 Nov 21 13:57:32.013012 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b61045dc-59c0-4c14-80f6-7e800a02ce1a req-45b6be6c-b0a1-4dcd-b852-de57f0b6f48e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:32.014370 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b61045dc-59c0-4c14-80f6-7e800a02ce1a req-45b6be6c-b0a1-4dcd-b852-de57f0b6f48e service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=24c864ef-5c5a-4df8-8968-78a7fe30b188&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0423851 Nov 21 13:57:32.103114 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b61045dc-59c0-4c14-80f6-7e800a02ce1a req-cb0bb481-c0a8-4ee8-b9e0-575ceeeb10f4 service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0807316 Nov 21 13:57:32.195443 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b61045dc-59c0-4c14-80f6-7e800a02ce1a req-94cda0d0-9b89-4734-b901-ae359540a920 service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842786 Nov 21 13:57:32.247347 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf756f5e-5bac-49e6-83a9-ddfa8d8c8298 req-40c66be0-a80a-43b0-8e52-f56a73b00cc8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:32.248839 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bf756f5e-5bac-49e6-83a9-ddfa8d8c8298 req-40c66be0-a80a-43b0-8e52-f56a73b00cc8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0484724 Nov 21 13:57:32.303707 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bf756f5e-5bac-49e6-83a9-ddfa8d8c8298 req-10a07f5f-3233-4d20-812d-468b42cf1da4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480876 Nov 21 13:57:32.576408 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-da49a182-48de-4503-892d-a8623b4d71bb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:33.422608 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b565bed-0757-425c-bd6b-9d8d1ab570d8 req-fa444ee2-bf65-4aef-903f-518268c366e0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:33.424079 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2b565bed-0757-425c-bd6b-9d8d1ab570d8 req-fa444ee2-bf65-4aef-903f-518268c366e0 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0474393 Nov 21 13:57:33.469391 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2b565bed-0757-425c-bd6b-9d8d1ab570d8 req-160fb6fd-3a9e-432e-b7bf-6684cb869879 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390394 Nov 21 13:57:33.883506 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:34.587840 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d211909c-2d17-4c7b-9288-4b71fd9dcbd0 req-b9f6fece-e500-4bed-bb89-f2cc42516e94 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:34.589189 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d211909c-2d17-4c7b-9288-4b71fd9dcbd0 req-b9f6fece-e500-4bed-bb89-f2cc42516e94 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 945 time: 0.0506313 Nov 21 13:57:34.635004 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d211909c-2d17-4c7b-9288-4b71fd9dcbd0 req-cbe3986f-44c7-4391-a4f8-5e408db1307d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399413 Nov 21 13:57:34.969939 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 73851145-2483-4c28-bf3b-f049e97c28cc no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:57:35.050432 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:35.083267 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:57:35.085535 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2666e480-f54b-4ad5-8131-c5889930ec65" -d '{"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-unplugged", "status": "completed", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:57:35.098573 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:35.102020 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 73851145-2483-4c28-bf3b-f049e97c28cc, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=73851145-2483-4c28-bf3b-f049e97c28cc,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:35.106518 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:35.131144 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Sun, 21 Nov 2021 13:57:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2c784e55-1004-4db0-8113-a0a5b51e8653 x-openstack-request-id: req-2c784e55-1004-4db0-8113-a0a5b51e8653 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:57:35.131432 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-unplugged", "status": "failed", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc", "code": 422}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:57:35.131684 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-2c784e55-1004-4db0-8113-a0a5b51e8653 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:57:35.132095 dv-cinder-768458-12-iscsi neutron-server[109042]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc', 'code': 422} returned with failed status Nov 21 13:57:35.160006 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=73851145-2483-4c28-bf3b-f049e97c28cc,revision_number=8']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:35.528783 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c2b35b-68bc-4a7a-90dc-ad5d9d5c5463 req-193ed9d9-10b3-4e7d-945f-9e4adf088c85 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:35.530240 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-37c2b35b-68bc-4a7a-90dc-ad5d9d5c5463 req-193ed9d9-10b3-4e7d-945f-9e4adf088c85 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0483410 Nov 21 13:57:35.579253 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-37c2b35b-68bc-4a7a-90dc-ad5d9d5c5463 req-fd53192f-8162-4fb8-b8fd-843f06b0386a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407963 Nov 21 13:57:35.800364 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 56706) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:35.850923 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:35.883928 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-335b2c6e-e111-4539-a712-022677b3804d req-2f4988c8-c068-4a2e-bc4f-86bfdabac72b service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0823882 Nov 21 13:57:35.893227 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [req-335b2c6e-e111-4539-a712-022677b3804d req-b88517d0-4b8c-4ee2-94e7-a80d8bfef2cd service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109040) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 13:57:35.894163 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-335b2c6e-e111-4539-a712-022677b3804d req-b88517d0-4b8c-4ee2-94e7-a80d8bfef2cd service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0053034 Nov 21 13:57:36.727280 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0cea5de-67e5-4b35-928e-f897d94264c5 req-b0ff507f-ae18-4ecd-9bef-443b90e59502 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:36.728748 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d0cea5de-67e5-4b35-928e-f897d94264c5 req-b0ff507f-ae18-4ecd-9bef-443b90e59502 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0770347 Nov 21 13:57:36.733978 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335b2c6e-e111-4539-a712-022677b3804d req-44eea41c-847c-4641-bacd-880abd3a1875 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:36.735823 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-335b2c6e-e111-4539-a712-022677b3804d req-44eea41c-847c-4641-bacd-880abd3a1875 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2&tenant_id=3d25ecbdc2ba435488271022d897a406 HTTP/1.1" status: 200 len: 1096 time: 0.0590708 Nov 21 13:57:36.800296 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d0cea5de-67e5-4b35-928e-f897d94264c5 req-008b9ef7-4ce8-44e5-9f82-78af4ed19886 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0635383 Nov 21 13:57:36.809525 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335b2c6e-e111-4539-a712-022677b3804d req-cdd3c52c-273a-4048-a033-734017b0974a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:36.810961 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-335b2c6e-e111-4539-a712-022677b3804d req-cdd3c52c-273a-4048-a033-734017b0974a service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 1096 time: 0.0500710 Nov 21 13:57:36.902173 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335b2c6e-e111-4539-a712-022677b3804d req-fef90e32-126f-450b-b499-c038c54f6f37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:36.903500 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-335b2c6e-e111-4539-a712-022677b3804d req-fef90e32-126f-450b-b499-c038c54f6f37 service neutron] 10.222.0.50 "GET /v2.0/networks?id=24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 200 len: 918 time: 0.0842588 Nov 21 13:57:36.967600 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-335b2c6e-e111-4539-a712-022677b3804d req-78c77e9a-0422-4696-9a5e-72f9ac988db3 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=73851145-2483-4c28-bf3b-f049e97c28cc HTTP/1.1" status: 200 len: 999 time: 0.0553575 Nov 21 13:57:37.015207 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335b2c6e-e111-4539-a712-022677b3804d req-265316c1-a357-473a-a608-5bf5f71c737f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:37.016628 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-335b2c6e-e111-4539-a712-022677b3804d req-265316c1-a357-473a-a608-5bf5f71c737f service neutron] 10.222.0.50 "GET /v2.0/subnets?id=c4887ea6-9c0e-4a7b-bd51-d70b335ceb92 HTTP/1.1" status: 200 len: 856 time: 0.0418241 Nov 21 13:57:37.064529 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335b2c6e-e111-4539-a712-022677b3804d req-5609b199-bb17-483a-9f81-9d2046e7465b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:37.066015 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-335b2c6e-e111-4539-a712-022677b3804d req-5609b199-bb17-483a-9f81-9d2046e7465b service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=24c864ef-5c5a-4df8-8968-78a7fe30b188&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0417359 Nov 21 13:57:37.152621 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-335b2c6e-e111-4539-a712-022677b3804d req-d817575c-97cc-4cbd-a684-a47a4e151461 service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0789118 Nov 21 13:57:37.244145 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-335b2c6e-e111-4539-a712-022677b3804d req-7df210b1-9abd-43f7-a871-4b991633e4b5 service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830448 Nov 21 13:57:37.949902 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15cc67e0-cc7a-42e9-bae9-ca1ca501c004 req-a48af0d6-9bf0-4385-8e6d-8159b5f295da tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:37.951407 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-15cc67e0-cc7a-42e9-bae9-ca1ca501c004 req-a48af0d6-9bf0-4385-8e6d-8159b5f295da tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0620253 Nov 21 13:57:38.004711 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-15cc67e0-cc7a-42e9-bae9-ca1ca501c004 req-3a26dcc1-c14e-4034-a412-c64f738a085c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453353 Nov 21 13:57:39.136609 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43d49c79-08aa-4967-b189-1567e61a3dab req-5f235c37-4e78-4038-bc3e-df9b7fc5173f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:39.138114 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-43d49c79-08aa-4967-b189-1567e61a3dab req-5f235c37-4e78-4038-bc3e-df9b7fc5173f tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0588858 Nov 21 13:57:39.192045 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-43d49c79-08aa-4967-b189-1567e61a3dab req-e33efbfb-66ee-4bbd-b0dc-6fdd51e8b588 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472119 Nov 21 13:57:40.317786 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84a7b0b5-6096-4c35-b98e-1db0b16ef53a req-43be87c0-7435-4828-8bac-8cc77c925416 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:40.319368 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-84a7b0b5-6096-4c35-b98e-1db0b16ef53a req-43be87c0-7435-4828-8bac-8cc77c925416 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0494974 Nov 21 13:57:40.373581 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-84a7b0b5-6096-4c35-b98e-1db0b16ef53a req-77b57dcf-1a64-4cac-ab0b-52fd69ea15ec tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469849 Nov 21 13:57:41.507909 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d980d04-531a-4895-b31d-0f7bb4543498 req-23f973cf-ee29-48bc-a687-63d14142ff8e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:41.509372 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1d980d04-531a-4895-b31d-0f7bb4543498 req-23f973cf-ee29-48bc-a687-63d14142ff8e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0620909 Nov 21 13:57:41.558805 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1d980d04-531a-4895-b31d-0f7bb4543498 req-a713d26a-4cc1-48fb-9fbc-e79fbc004d0c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431437 Nov 21 13:57:42.679705 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07d1e874-7dfb-4eb5-8b19-238a968f8f64 req-7b19ee03-9448-488c-85b8-441817f7ceb1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:42.681354 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-07d1e874-7dfb-4eb5-8b19-238a968f8f64 req-7b19ee03-9448-488c-85b8-441817f7ceb1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0492220 Nov 21 13:57:42.732802 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-07d1e874-7dfb-4eb5-8b19-238a968f8f64 req-eeb226c8-7417-4c03-b3d9-e2196c4c9c6c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452991 Nov 21 13:57:43.103882 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-053ac699-a51f-42ef-ad8f-32a057778fcb req-bfa9c062-10c9-4938-805c-6634556e6ab0 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-858840109&fields=id&tenant_id=406bef8592334a749f671da6881b0cf5 HTTP/1.1" status: 200 len: 267 time: 0.0484674 Nov 21 13:57:43.158604 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-053ac699-a51f-42ef-ad8f-32a057778fcb req-b2f78fd4-c5f9-41cd-896d-a146677a535e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:43.160208 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-053ac699-a51f-42ef-ad8f-32a057778fcb req-b2f78fd4-c5f9-41cd-896d-a146677a535e tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 984 time: 0.0498192 Nov 21 13:57:43.172646 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-053ac699-a51f-42ef-ad8f-32a057778fcb req-dd4b93a2-2e8e-458d-aee1-c39161bd7748 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Request body: {'port': {'security_groups': ['dcfd3018-6236-44ab-a1ee-abdf37bb89a5']}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:57:43.240655 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-053ac699-a51f-42ef-ad8f-32a057778fcb req-dd4b93a2-2e8e-458d-aee1-c39161bd7748 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:43.696325 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-053ac699-a51f-42ef-ad8f-32a057778fcb req-dd4b93a2-2e8e-458d-aee1-c39161bd7748 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] For port 0f9a92e8-efd7-45cc-b13f-25658f0506ad, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=0f9a92e8-efd7-45cc-b13f-25658f0506ad,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:43.728552 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-053ac699-a51f-42ef-ad8f-32a057778fcb req-dd4b93a2-2e8e-458d-aee1-c39161bd7748 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:43.734937 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-053ac699-a51f-42ef-ad8f-32a057778fcb req-dd4b93a2-2e8e-458d-aee1-c39161bd7748 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:43.747588 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['0f9a92e8-efd7-45cc-b13f-25658f0506ad'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:57:43.795379 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-053ac699-a51f-42ef-ad8f-32a057778fcb req-dd4b93a2-2e8e-458d-aee1-c39161bd7748 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:43.796066 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-053ac699-a51f-42ef-ad8f-32a057778fcb req-dd4b93a2-2e8e-458d-aee1-c39161bd7748 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:43.804071 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 56778) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:43.804557 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-053ac699-a51f-42ef-ad8f-32a057778fcb req-dd4b93a2-2e8e-458d-aee1-c39161bd7748 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "PUT /v2.0/ports/0f9a92e8-efd7-45cc-b13f-25658f0506ad HTTP/1.1" status: 200 len: 942 time: 0.6373506 Nov 21 13:57:43.807249 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:57:43.809218 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a35e6ad-229c-4ede-9e77-9c443450c6bf" -d '{"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:57:43.870434 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd4b93a2-2e8e-458d-aee1-c39161bd7748 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event updated for resources: {'Port': ['ID=0f9a92e8-efd7-45cc-b13f-25658f0506ad,revision_number=7']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:43.953536 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:57:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54fe2548-518f-430b-98e6-36fb1f2a6b7f x-openstack-request-id: req-54fe2548-518f-430b-98e6-36fb1f2a6b7f {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:57:43.954093 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:57:43.954634 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-54fe2548-518f-430b-98e6-36fb1f2a6b7f {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:57:43.955323 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad', 'status': 'completed', 'code': 200} Nov 21 13:57:43.961555 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['0f9a92e8-efd7-45cc-b13f-25658f0506ad'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:57:43.998629 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-04b0acfb-b398-4783-9af4-9f0743ac683b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:44.063760 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-04b0acfb-b398-4783-9af4-9f0743ac683b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:44.122215 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abf7648d-ad84-4ac1-9ef6-519b62737114 req-8afb5b05-d1bd-40f1-b1ce-2e412fc9ad9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:44.123916 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-abf7648d-ad84-4ac1-9ef6-519b62737114 req-8afb5b05-d1bd-40f1-b1ce-2e412fc9ad9c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.2295384 Nov 21 13:57:44.201582 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-2c8ebb0c-30be-48e9-b47e-ee8d05e5fdf9 None None] Provisioning complete for port 0f9a92e8-efd7-45cc-b13f-25658f0506ad triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:57:44.201850 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-2c8ebb0c-30be-48e9-b47e-ee8d05e5fdf9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:44.212667 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-abf7648d-ad84-4ac1-9ef6-519b62737114 req-6e8ef72f-7c2f-40ec-b8a9-fbb066556956 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0598800 Nov 21 13:57:44.225861 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-04b0acfb-b398-4783-9af4-9f0743ac683b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:44.232542 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-04b0acfb-b398-4783-9af4-9f0743ac683b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:44.236857 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-04b0acfb-b398-4783-9af4-9f0743ac683b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "DELETE /v2.0/security-groups/42126e3d-39be-4ee1-969d-6af11887f875 HTTP/1.1" status: 204 len: 168 time: 0.4292214 Nov 21 13:57:44.237783 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 56784) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:44.244279 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04b0acfb-b398-4783-9af4-9f0743ac683b tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=42126e3d-39be-4ee1-969d-6af11887f875,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:44.436411 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-5a1b907b-c1a7-404d-841f-34f95a2ded6f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Deleting port f6ee5d13-8a33-47b6-9511-a990b3947850 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:57:44.436865 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5a1b907b-c1a7-404d-841f-34f95a2ded6f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:44.511459 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5a1b907b-c1a7-404d-841f-34f95a2ded6f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:44.511779 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5a1b907b-c1a7-404d-841f-34f95a2ded6f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:44.524574 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-5a1b907b-c1a7-404d-841f-34f95a2ded6f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling delete_port for f6ee5d13-8a33-47b6-9511-a990b3947850 owned by network:floatingip {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:57:44.721326 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5a1b907b-c1a7-404d-841f-34f95a2ded6f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:44.751596 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a1b907b-c1a7-404d-841f-34f95a2ded6f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event deleted for resources: {'Port': ['ID=f6ee5d13-8a33-47b6-9511-a990b3947850,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:44.811744 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5a1b907b-c1a7-404d-841f-34f95a2ded6f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks [] for floatingip, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:44.813005 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.l3_db [None req-5a1b907b-c1a7-404d-841f-34f95a2ded6f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Floating IP e3393974-141a-4a0e-93e6-13bbaff6459b disassociated (deleted). External IP: 172.27.1.13, port: 0f9a92e8-efd7-45cc-b13f-25658f0506ad. Nov 21 13:57:45.038825 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a1b907b-c1a7-404d-841f-34f95a2ded6f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Router 97eb221f-bbef-4cab-b393-a7606b8c7477 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:57:45.153244 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a1b907b-c1a7-404d-841f-34f95a2ded6f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:57:45.158667 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5a1b907b-c1a7-404d-841f-34f95a2ded6f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:45.165538 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd299d25-c3ff-4043-b79a-4d6c7a9a2609 None None] Sync routers for ids ['97eb221f-bbef-4cab-b393-a7606b8c7477'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:57:45.184587 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd299d25-c3ff-4043-b79a-4d6c7a9a2609 None None] Routers {'97eb221f-bbef-4cab-b393-a7606b8c7477'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:57:45.185195 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-bd299d25-c3ff-4043-b79a-4d6c7a9a2609 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:57:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['97eb221f-bbef-4cab-b393-a7606b8c7477'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:45.185875 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-5a1b907b-c1a7-404d-841f-34f95a2ded6f tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "DELETE /v2.0/floatingips/e3393974-141a-4a0e-93e6-13bbaff6459b HTTP/1.1" status: 204 len: 168 time: 0.9463179 Nov 21 13:57:45.317468 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-bd299d25-c3ff-4043-b79a-4d6c7a9a2609 None None] Set router 97eb221f-bbef-4cab-b393-a7606b8c7477 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:57:45.469380 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91998cad-9739-4309-85ad-330c28d26f53 req-6a6d72b7-1beb-4b61-84a5-48f98a6b257d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:45.480629 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-91998cad-9739-4309-85ad-330c28d26f53 req-6a6d72b7-1beb-4b61-84a5-48f98a6b257d tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.1046603 Nov 21 13:57:45.571133 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-91998cad-9739-4309-85ad-330c28d26f53 req-b270d5f2-e45f-495f-bdde-a8d6dc0b741a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0885656 Nov 21 13:57:45.583756 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-bd299d25-c3ff-4043-b79a-4d6c7a9a2609 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38'}], 'enable_snat': True}, 'gw_port_id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:01Z', 'revision_number': 4, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port': {'id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:b6:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'd03b886a-1564-44d9-a5a2-34ff7929ef4b', 'name': '', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'mac_address': 'fa:16:3e:23:78:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:00Z', 'updated_at': '2021-11-21T13:55:05Z', 'revision_number': 5, 'project_id': '406bef8592334a749f671da6881b0cf5', 'subnets': [{'id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:45.610786 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd299d25-c3ff-4043-b79a-4d6c7a9a2609 None None] Checking router: 97eb221f-bbef-4cab-b393-a7606b8c7477 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:57:45.619596 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd299d25-c3ff-4043-b79a-4d6c7a9a2609 None None] Routers {'97eb221f-bbef-4cab-b393-a7606b8c7477'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:57:45.620241 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-bd299d25-c3ff-4043-b79a-4d6c7a9a2609 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:57:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['97eb221f-bbef-4cab-b393-a7606b8c7477'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:45.730219 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-bd299d25-c3ff-4043-b79a-4d6c7a9a2609 None None] Set router 97eb221f-bbef-4cab-b393-a7606b8c7477 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:57:45.933152 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-bd299d25-c3ff-4043-b79a-4d6c7a9a2609 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38'}], 'enable_snat': True}, 'gw_port_id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:01Z', 'revision_number': 4, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port': {'id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:b6:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'd03b886a-1564-44d9-a5a2-34ff7929ef4b', 'name': '', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'mac_address': 'fa:16:3e:23:78:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:00Z', 'updated_at': '2021-11-21T13:55:05Z', 'revision_number': 5, 'project_id': '406bef8592334a749f671da6881b0cf5', 'subnets': [{'id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:45.956517 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:57:45.959268 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278" -d '{"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:57:45.964802 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd299d25-c3ff-4043-b79a-4d6c7a9a2609 None None] The sync data for ids ['97eb221f-bbef-4cab-b393-a7606b8c7477'] in dv-cinder-768458-12-iscsi is: [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38'}], 'enable_snat': True}, 'gw_port_id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:01Z', 'revision_number': 4, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port': {'id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:b6:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'd03b886a-1564-44d9-a5a2-34ff7929ef4b', 'name': '', 'network_id': '34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'mac_address': 'fa:16:3e:23:78:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_interface', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:00Z', 'updated_at': '2021-11-21T13:55:05Z', 'revision_number': 5, 'project_id': '406bef8592334a749f671da6881b0cf5', 'subnets': [{'id': '7cdb43d5-ad8a-4fcf-8b29-113b86f21514', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:57:45.995446 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:57:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64cad0dc-ccf3-4e4d-b399-bd66e573f96e x-openstack-request-id: req-64cad0dc-ccf3-4e4d-b399-bd66e573f96e {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:57:45.995752 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:57:45.996052 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-64cad0dc-ccf3-4e4d-b399-bd66e573f96e {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:57:45.996454 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad', 'status': 'completed', 'code': 200} Nov 21 13:57:46.225764 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b56019fb-b505-484d-95a8-50961fd81bf6 None None] New status for floating IP e3393974-141a-4a0e-93e6-13bbaff6459b: DOWN {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 13:57:46.701600 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2621014b-f073-446d-aa4b-cd8e6f46d371 req-4ebcc091-238c-494b-837b-17b65da729d4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:46.703088 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2621014b-f073-446d-aa4b-cd8e6f46d371 req-4ebcc091-238c-494b-837b-17b65da729d4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0492473 Nov 21 13:57:46.760375 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2621014b-f073-446d-aa4b-cd8e6f46d371 req-f411d1bb-ec1f-4840-b7d7-cc0b748c83d4 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511229 Nov 21 13:57:47.881843 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9612ae60-80a0-42d3-a7d9-ee5c08789b11 req-b3d3655b-fda0-4853-ad5f-ff54555a2bd8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:47.883328 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9612ae60-80a0-42d3-a7d9-ee5c08789b11 req-b3d3655b-fda0-4853-ad5f-ff54555a2bd8 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0568211 Nov 21 13:57:47.933653 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9612ae60-80a0-42d3-a7d9-ee5c08789b11 req-462489e0-cdc7-4138-bc84-2f2aa72c767e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443425 Nov 21 13:57:48.754773 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-2cec5081-cd68-46f1-809c-696ad5ebd551 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:48.756327 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-2cec5081-cd68-46f1-809c-696ad5ebd551 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=406bef8592334a749f671da6881b0cf5&device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 1098 time: 0.0451634 Nov 21 13:57:48.860366 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-93015d58-62cf-4f79-8600-3cf250ecea59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:48.861860 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-93015d58-62cf-4f79-8600-3cf250ecea59 service neutron] 10.222.0.50 "GET /v2.0/networks?id=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 HTTP/1.1" status: 200 len: 915 time: 0.0983288 Nov 21 13:57:48.906400 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-9f777ce7-4fe3-4919-9809-df7832121cf2 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0f9a92e8-efd7-45cc-b13f-25658f0506ad HTTP/1.1" status: 200 len: 217 time: 0.0361438 Nov 21 13:57:48.958747 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-e1c81d76-88c6-4d77-b9f0-ed68991f06bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:48.960185 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-e1c81d76-88c6-4d77-b9f0-ed68991f06bc service neutron] 10.222.0.50 "GET /v2.0/subnets?id=7cdb43d5-ad8a-4fcf-8b29-113b86f21514 HTTP/1.1" status: 200 len: 853 time: 0.0443280 Nov 21 13:57:49.006654 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-b315f4d3-16e7-4c88-b3e3-d1cec851a865 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:49.008182 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-b315f4d3-16e7-4c88-b3e3-d1cec851a865 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0408502 Nov 21 13:57:49.113324 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac0c2553-9d18-4d81-a85f-cbc31e9342c7 req-e5df91ed-6f66-4992-8038-6340cae2f73e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:49.115081 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ac0c2553-9d18-4d81-a85f-cbc31e9342c7 req-e5df91ed-6f66-4992-8038-6340cae2f73e tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.1060278 Nov 21 13:57:49.149009 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-e324efca-8972-4ba9-9cc9-edf71b5d7147 service neutron] 10.222.0.50 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1306798 Nov 21 13:57:49.225283 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ac0c2553-9d18-4d81-a85f-cbc31e9342c7 req-24f0829c-6735-4e7f-82e6-0eddd861f842 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1017814 Nov 21 13:57:49.264204 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4a35e6ad-229c-4ede-9e77-9c443450c6bf req-c4a26121-19b7-4b2c-9546-3fe9826bb7e1 service neutron] 10.222.0.50 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1018531 Nov 21 13:57:49.348777 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-938043d1-9a01-493e-a683-78d482d0d7d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:49.350252 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-938043d1-9a01-493e-a683-78d482d0d7d9 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=406bef8592334a749f671da6881b0cf5&device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 1098 time: 0.0409675 Nov 21 13:57:49.443321 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-62202703-2dd5-4d27-a140-e114ea31a9ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:49.444846 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-62202703-2dd5-4d27-a140-e114ea31a9ce service neutron] 10.222.0.50 "GET /v2.0/networks?id=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 HTTP/1.1" status: 200 len: 915 time: 0.0869417 Nov 21 13:57:49.486935 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-86b567d7-fe79-4bc5-90f3-cfbf36252173 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0f9a92e8-efd7-45cc-b13f-25658f0506ad HTTP/1.1" status: 200 len: 217 time: 0.0331657 Nov 21 13:57:49.537166 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-5faedf7a-0ded-42bd-bc91-dc14577ceb59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:49.538558 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-5faedf7a-0ded-42bd-bc91-dc14577ceb59 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=7cdb43d5-ad8a-4fcf-8b29-113b86f21514 HTTP/1.1" status: 200 len: 853 time: 0.0436361 Nov 21 13:57:49.588338 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-a6cd6b03-5c5c-4e82-b96b-3ee94a81a138 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:49.589765 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-a6cd6b03-5c5c-4e82-b96b-3ee94a81a138 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0422809 Nov 21 13:57:49.677570 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-fbd9f3b6-83e4-4d9f-81c6-0cd0fd6b3a20 service neutron] 10.222.0.50 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0792565 Nov 21 13:57:49.777927 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-aeb6469c-aa6e-4756-9edd-0ec8d3a95278 req-198acb48-78b3-4397-811b-bf419b728402 service neutron] 10.222.0.50 "GET /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0924668 Nov 21 13:57:50.347968 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ee311a9-1644-46eb-80a1-133ca8824d63 req-22fe5d16-b025-4ae1-892e-ad350e2fce9a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:50.349484 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4ee311a9-1644-46eb-80a1-133ca8824d63 req-22fe5d16-b025-4ae1-892e-ad350e2fce9a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 943 time: 0.0502810 Nov 21 13:57:50.397964 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-4ee311a9-1644-46eb-80a1-133ca8824d63 req-20294e92-680f-44ea-b23d-7aebfba078e5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423236 Nov 21 13:57:51.060461 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 73851145-2483-4c28-bf3b-f049e97c28cc details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:57:51.164004 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 73851145-2483-4c28-bf3b-f049e97c28cc, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=73851145-2483-4c28-bf3b-f049e97c28cc,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:51.179629 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '73851145-2483-4c28-bf3b-f049e97c28cc', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'port_id': '73851145-2483-4c28-bf3b-f049e97c28cc', 'mac_address': 'fa:16:3e:e1:6b:20', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 524, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:57:51.216363 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:51.229279 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 73851145-2483-4c28-bf3b-f049e97c28cc {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:57:51.248719 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 73851145-2483-4c28-bf3b-f049e97c28cc, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=73851145-2483-4c28-bf3b-f049e97c28cc,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:51.252381 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:51.298128 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=73851145-2483-4c28-bf3b-f049e97c28cc,revision_number=9']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:51.305061 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:51.305433 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:51.305782 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:51.306114 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:51.306462 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:51.306804 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:51.307131 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:51.307454 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:51.307778 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:51.308123 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:51.308443 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:51.308762 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:57:51.520326 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee865ce2-719f-4d1a-93bf-a2d62e3ee650 req-cf72bab9-99dc-4562-ae17-f76d7b3d18ba tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:51.521806 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ee865ce2-719f-4d1a-93bf-a2d62e3ee650 req-cf72bab9-99dc-4562-ae17-f76d7b3d18ba tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 944 time: 0.0543213 Nov 21 13:57:51.537474 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['73851145-2483-4c28-bf3b-f049e97c28cc'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:57:51.573751 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ee865ce2-719f-4d1a-93bf-a2d62e3ee650 req-562cee86-17e6-427f-8141-e4d708279459 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453475 Nov 21 13:57:52.204451 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-382c03aa-4524-4d54-93d6-262053f99c55 req-6fc77229-0000-4385-856a-8ea0b1bfa383 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:52.205897 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-382c03aa-4524-4d54-93d6-262053f99c55 req-6fc77229-0000-4385-856a-8ea0b1bfa383 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 945 time: 0.0475571 Nov 21 13:57:52.252989 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-382c03aa-4524-4d54-93d6-262053f99c55 req-777d8a76-6aae-45dd-915d-16970de8e7e5 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412047 Nov 21 13:57:52.586848 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:52.698658 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc7e869d-c713-4fee-ab16-a1c91f96ba0c req-da2bcf12-9532-42e5-a7e2-c2fad524f976 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:52.700117 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-cc7e869d-c713-4fee-ab16-a1c91f96ba0c req-da2bcf12-9532-42e5-a7e2-c2fad524f976 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 944 time: 0.0485263 Nov 21 13:57:52.747199 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-cc7e869d-c713-4fee-ab16-a1c91f96ba0c req-bf83d48e-f064-4f98-8674-435ac68821b6 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411551 Nov 21 13:57:53.072108 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 73851145-2483-4c28-bf3b-f049e97c28cc up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:57:53.119859 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 73851145-2483-4c28-bf3b-f049e97c28cc triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:57:53.120230 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:53.197990 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:53.221081 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:57:53.223301 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4907e29-f56e-444d-bd1e-9f68c05f3cc7" -d '{"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-plugged", "status": "completed", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:57:53.236202 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 73851145-2483-4c28-bf3b-f049e97c28cc, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=73851145-2483-4c28-bf3b-f049e97c28cc,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:53.242360 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:53.267549 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:57:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b51b39ad-3209-4d70-b686-1754b2a75bcd x-openstack-request-id: req-b51b39ad-3209-4d70-b686-1754b2a75bcd {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:57:53.267950 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-plugged", "status": "completed", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:57:53.268216 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-b51b39ad-3209-4d70-b686-1754b2a75bcd {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:57:53.269277 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc', 'code': 200} Nov 21 13:57:53.310146 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=73851145-2483-4c28-bf3b-f049e97c28cc,revision_number=10']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:53.387104 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-151b3e45-6c25-4783-8b6b-8a28a6daa51d req-ed34d609-e46a-45bc-a3ab-2186f4399b02 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:53.388672 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-151b3e45-6c25-4783-8b6b-8a28a6daa51d req-ed34d609-e46a-45bc-a3ab-2186f4399b02 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 945 time: 0.0639212 Nov 21 13:57:53.447003 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-151b3e45-6c25-4783-8b6b-8a28a6daa51d req-5754f4bd-149d-4971-8291-5de6a452a672 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515797 Nov 21 13:57:53.463480 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf155ea-d9d4-45f5-87f3-c485e6d6c4e7 req-c0c01446-1f42-46b3-a242-48b290e02dfc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:53.464970 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-caf155ea-d9d4-45f5-87f3-c485e6d6c4e7 req-c0c01446-1f42-46b3-a242-48b290e02dfc tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 945 time: 0.0511296 Nov 21 13:57:53.479264 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6f921f-7004-447d-9ec1-464b28f9d66a req-d2face8a-f35e-4412-9738-b5eb1a26d53d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:53.480874 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ae6f921f-7004-447d-9ec1-464b28f9d66a req-d2face8a-f35e-4412-9738-b5eb1a26d53d service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 1099 time: 0.0466802 Nov 21 13:57:53.514671 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-caf155ea-d9d4-45f5-87f3-c485e6d6c4e7 req-f0251071-0667-478a-b829-223a2cf906d1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe1f10dd-0418-4dff-bc67-cd614e6291d3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436487 Nov 21 13:57:53.526469 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ae6f921f-7004-447d-9ec1-464b28f9d66a req-559b22df-b73b-4421-b823-4fabf50b1028 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378108 Nov 21 13:57:53.613254 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:57:53.866345 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c1a7728-dcda-499b-b7ab-509da0bccbac req-fcc36abd-a99d-4cbd-b813-1a8b252e314c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:53.867857 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2c1a7728-dcda-499b-b7ab-509da0bccbac req-fcc36abd-a99d-4cbd-b813-1a8b252e314c tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 946 time: 0.0484457 Nov 21 13:57:53.939751 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2c1a7728-dcda-499b-b7ab-509da0bccbac req-b3263b68-4a25-47cb-9058-937c76948134 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0655768 Nov 21 13:57:53.945832 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d528d4d3-2ff1-4120-9a70-573ab44f2ba6 req-646693ff-4a50-4022-bb3a-22f4d33a7481 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:53.947224 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d528d4d3-2ff1-4120-9a70-573ab44f2ba6 req-646693ff-4a50-4022-bb3a-22f4d33a7481 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3d25ecbdc2ba435488271022d897a406&device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 1099 time: 0.0657778 Nov 21 13:57:54.058209 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d528d4d3-2ff1-4120-9a70-573ab44f2ba6 req-7c6f1f94-4905-4355-935f-61ef68325a26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:54.059533 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d528d4d3-2ff1-4120-9a70-573ab44f2ba6 req-7c6f1f94-4905-4355-935f-61ef68325a26 service neutron] 10.222.0.50 "GET /v2.0/networks?id=24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 200 len: 918 time: 0.0837169 Nov 21 13:57:54.124565 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d528d4d3-2ff1-4120-9a70-573ab44f2ba6 req-273401b3-7005-4f9c-9c71-ba0d444824bd service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=73851145-2483-4c28-bf3b-f049e97c28cc HTTP/1.1" status: 200 len: 1001 time: 0.0555134 Nov 21 13:57:54.179538 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d528d4d3-2ff1-4120-9a70-573ab44f2ba6 req-bbc1325a-7e93-4918-b839-b2c4e9894390 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:54.181043 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d528d4d3-2ff1-4120-9a70-573ab44f2ba6 req-bbc1325a-7e93-4918-b839-b2c4e9894390 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=c4887ea6-9c0e-4a7b-bd51-d70b335ceb92 HTTP/1.1" status: 200 len: 856 time: 0.0467060 Nov 21 13:57:54.234370 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d528d4d3-2ff1-4120-9a70-573ab44f2ba6 req-2a6c52f4-bb31-480c-aeac-43e902ce4744 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:54.236108 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d528d4d3-2ff1-4120-9a70-573ab44f2ba6 req-2a6c52f4-bb31-480c-aeac-43e902ce4744 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=24c864ef-5c5a-4df8-8968-78a7fe30b188&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0422578 Nov 21 13:57:54.332276 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d528d4d3-2ff1-4120-9a70-573ab44f2ba6 req-377decc6-61d6-4a9f-addb-3a5732729a0a service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858560 Nov 21 13:57:54.461282 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12e79d4f-1a58-43e7-967d-ec2e612b110b req-89a44d13-5cad-4f80-bce8-a948ca250419 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:54.462733 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-12e79d4f-1a58-43e7-967d-ec2e612b110b req-89a44d13-5cad-4f80-bce8-a948ca250419 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.50 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 945 time: 0.0702896 Nov 21 13:57:54.464478 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d528d4d3-2ff1-4120-9a70-573ab44f2ba6 req-f5b8c7b2-c4d6-4baa-a98e-d5a1c1ae1dbb service neutron] 10.222.0.50 "GET /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1244931 Nov 21 13:57:54.575906 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-12e79d4f-1a58-43e7-967d-ec2e612b110b req-4b547f01-93cd-49c2-81da-ef45e5a09e83 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Deleting port 0f9a92e8-efd7-45cc-b13f-25658f0506ad {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:57:54.576659 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-12e79d4f-1a58-43e7-967d-ec2e612b110b req-4b547f01-93cd-49c2-81da-ef45e5a09e83 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:54.707496 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1f6c496-92f6-43be-81b0-cc3508eae91a req-20386759-8ffc-47ee-8571-f530398314d8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:54.709012 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f1f6c496-92f6-43be-81b0-cc3508eae91a req-20386759-8ffc-47ee-8571-f530398314d8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 945 time: 0.1174970 Nov 21 13:57:54.726495 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-12e79d4f-1a58-43e7-967d-ec2e612b110b req-4b547f01-93cd-49c2-81da-ef45e5a09e83 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] For port 0f9a92e8-efd7-45cc-b13f-25658f0506ad, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=0f9a92e8-efd7-45cc-b13f-25658f0506ad,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:54.726861 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-12e79d4f-1a58-43e7-967d-ec2e612b110b req-4b547f01-93cd-49c2-81da-ef45e5a09e83 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:54.748660 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-12e79d4f-1a58-43e7-967d-ec2e612b110b req-4b547f01-93cd-49c2-81da-ef45e5a09e83 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Calling delete_port for 0f9a92e8-efd7-45cc-b13f-25658f0506ad owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:57:54.778980 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aebfaffb-d1e0-49c4-916b-910e0bc0e188 req-aab1dacb-8dc5-4ad2-941c-507833f63015 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:54.780495 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-aebfaffb-d1e0-49c4-916b-910e0bc0e188 req-aab1dacb-8dc5-4ad2-941c-507833f63015 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/ports?device_id=9b1367a1-8117-4d60-9d06-1a59f6ac647d HTTP/1.1" status: 200 len: 945 time: 0.2660546 Nov 21 13:57:54.812994 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f1f6c496-92f6-43be-81b0-cc3508eae91a req-018c013c-b212-4505-89de-98f357349f59 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe1f10dd-0418-4dff-bc67-cd614e6291d3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0952501 Nov 21 13:57:54.843948 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-aebfaffb-d1e0-49c4-916b-910e0bc0e188 req-9a9fff0f-7788-4ace-8dd5-1fab6551c25d tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.11 "GET /v2.0/security-groups?id=dcfd3018-6236-44ab-a1ee-abdf37bb89a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503597 Nov 21 13:57:54.911950 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-12e79d4f-1a58-43e7-967d-ec2e612b110b req-4b547f01-93cd-49c2-81da-ef45e5a09e83 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:54.925702 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['0f9a92e8-efd7-45cc-b13f-25658f0506ad'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:57:54.943276 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b547f01-93cd-49c2-81da-ef45e5a09e83 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Pushing event deleted for resources: {'Port': ['ID=0f9a92e8-efd7-45cc-b13f-25658f0506ad,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:54.984714 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-12e79d4f-1a58-43e7-967d-ec2e612b110b req-4b547f01-93cd-49c2-81da-ef45e5a09e83 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] No DVR routers for this DVR port 0f9a92e8-efd7-45cc-b13f-25658f0506ad on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:57:54.987301 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-12e79d4f-1a58-43e7-967d-ec2e612b110b req-4b547f01-93cd-49c2-81da-ef45e5a09e83 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:54.990741 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-12e79d4f-1a58-43e7-967d-ec2e612b110b req-4b547f01-93cd-49c2-81da-ef45e5a09e83 tempest-TestMinimumBasicScenario-1533878579 tempest-TestMinimumBasicScenario-1533878579-project] 10.222.0.50 "DELETE /v2.0/ports/0f9a92e8-efd7-45cc-b13f-25658f0506ad HTTP/1.1" status: 204 len: 173 time: 0.5136673 Nov 21 13:57:54.991190 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'name': 'network-vif-deleted', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:57:54.993483 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-309484c0-578a-4421-9b39-0604597e90a8" -d '{"events": [{"server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "name": "network-vif-deleted", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:57:55.039133 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:57:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b842157f-ac21-448c-8a9c-36306baedeba x-openstack-request-id: req-b842157f-ac21-448c-8a9c-36306baedeba {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:57:55.039433 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9b1367a1-8117-4d60-9d06-1a59f6ac647d", "name": "network-vif-deleted", "tag": "0f9a92e8-efd7-45cc-b13f-25658f0506ad", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:57:55.039691 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-b842157f-ac21-448c-8a9c-36306baedeba {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:57:55.040113 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9b1367a1-8117-4d60-9d06-1a59f6ac647d', 'name': 'network-vif-deleted', 'tag': '0f9a92e8-efd7-45cc-b13f-25658f0506ad', 'status': 'completed', 'code': 200} Nov 21 13:57:55.092597 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25b7ae05-c60d-4fad-9562-211483ac9bc0 req-16192642-7265-4558-a54c-430644cc57ba tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:55.094907 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-25b7ae05-c60d-4fad-9562-211483ac9bc0 req-16192642-7265-4558-a54c-430644cc57ba tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 946 time: 0.0740929 Nov 21 13:57:55.158510 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-25b7ae05-c60d-4fad-9562-211483ac9bc0 req-b7e49dfa-a153-4f0a-9d82-5848b9bc4206 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0562997 Nov 21 13:57:55.753625 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3ffe78f-d553-4571-b93f-082357099b61 req-506ca4bc-655c-469d-bbe8-7b5b8776dcc8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:55.755020 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f3ffe78f-d553-4571-b93f-082357099b61 req-506ca4bc-655c-469d-bbe8-7b5b8776dcc8 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.50 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 945 time: 0.0540259 Nov 21 13:57:55.844479 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Deleting port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:57:55.845179 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:55.934992 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88f893ef-ff0a-4c0b-afd4-3a467efca421 req-9653b0c8-e3c7-4787-92e2-a8f7dfbbba73 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:55.936605 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-88f893ef-ff0a-4c0b-afd4-3a467efca421 req-9653b0c8-e3c7-4787-92e2-a8f7dfbbba73 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 945 time: 0.0498207 Nov 21 13:57:55.946831 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] For port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8f627980-8d41-4f62-bfa8-683b4cdc0b4c,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:55.947351 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:55.989098 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-88f893ef-ff0a-4c0b-afd4-3a467efca421 req-b4897a06-12e9-4407-8bee-23e24d76b6b1 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe1f10dd-0418-4dff-bc67-cd614e6291d3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449753 Nov 21 13:57:56.131113 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:56.131352 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:56.131643 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.l3_db [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Floating IP f8b3c7bf-cb9f-4d02-9d64-455c864da562 disassociated. External IP: 172.27.1.180, port: 8f627980-8d41-4f62-bfa8-683b4cdc0b4c. Nov 21 13:57:56.132117 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling delete_port for 8f627980-8d41-4f62-bfa8-683b4cdc0b4c owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:57:56.310737 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2fadb42-5119-4d42-80a0-c6cdf6d5cbe7 req-5967ae0a-0afe-4f67-b5e3-c9d9e33d74fb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:57:56.313006 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a2fadb42-5119-4d42-80a0-c6cdf6d5cbe7 req-5967ae0a-0afe-4f67-b5e3-c9d9e33d74fb tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 946 time: 0.0735688 Nov 21 13:57:56.313632 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:56.360043 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event deleted for resources: {'Port': ['ID=8f627980-8d41-4f62-bfa8-683b4cdc0b4c,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:56.395016 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 56992) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:56.432325 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a2fadb42-5119-4d42-80a0-c6cdf6d5cbe7 req-1e5682ba-fac9-49f5-a6fa-b5f0891670c5 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1121371 Nov 21 13:57:56.501880 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Router 65d15860-a1d7-449d-b2d9-7210d0a1d10b has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:57:56.610980 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:57:56.621501 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15d6ed4f-e990-4972-97ba-48698aefe4ac None None] Sync routers for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:57:56.631927 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15d6ed4f-e990-4972-97ba-48698aefe4ac None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:57:56.632485 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-15d6ed4f-e990-4972-97ba-48698aefe4ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:57:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:56.653955 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] No DVR routers for this DVR port 8f627980-8d41-4f62-bfa8-683b4cdc0b4c on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:57:56.657064 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:56.660344 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f3ffe78f-d553-4571-b93f-082357099b61 req-e2f1eef7-09d6-400f-914a-ead845e0d6cf tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.50 "DELETE /v2.0/ports/8f627980-8d41-4f62-bfa8-683b4cdc0b4c HTTP/1.1" status: 204 len: 173 time: 0.8991575 Nov 21 13:57:56.756410 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0fd3891d-51cc-4796-aa91-c6652145c474 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-473237'] for router_interface, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:56.879043 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-15d6ed4f-e990-4972-97ba-48698aefe4ac None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:57:57.017849 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-0fd3891d-51cc-4796-aa91-c6652145c474 admin admin] Deleting port d03b886a-1564-44d9-a5a2-34ff7929ef4b {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:57:57.018378 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0fd3891d-51cc-4796-aa91-c6652145c474 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:57.041722 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fe7c81c3-cb32-476d-97c8-9a0d8d19f156', 'name': 'network-vif-deleted', 'tag': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:57:57.044310 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-78b6ff5a-1931-4124-84c5-6dc5d04feb82" -d '{"events": [{"server_uuid": "fe7c81c3-cb32-476d-97c8-9a0d8d19f156", "name": "network-vif-deleted", "tag": "8f627980-8d41-4f62-bfa8-683b4cdc0b4c"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:57:57.084939 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-15d6ed4f-e990-4972-97ba-48698aefe4ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 5, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:57.092983 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:57:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-01750754-d390-464a-a820-923643b65e18 x-openstack-request-id: req-01750754-d390-464a-a820-923643b65e18 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:57:57.096324 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fe7c81c3-cb32-476d-97c8-9a0d8d19f156", "name": "network-vif-deleted", "tag": "8f627980-8d41-4f62-bfa8-683b4cdc0b4c", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:57:57.096585 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-01750754-d390-464a-a820-923643b65e18 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:57:57.097098 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fe7c81c3-cb32-476d-97c8-9a0d8d19f156', 'name': 'network-vif-deleted', 'tag': '8f627980-8d41-4f62-bfa8-683b4cdc0b4c', 'status': 'completed', 'code': 200} Nov 21 13:57:57.117039 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-068ce943-9107-4253-96c1-b30cb74e74af req-e5bbd380-b172-4648-a9e7-92ba1e860d7e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe7c81c3-cb32-476d-97c8-9a0d8d19f156 HTTP/1.1" status: 200 len: 210 time: 0.0363870 Nov 21 13:57:57.122732 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15d6ed4f-e990-4972-97ba-48698aefe4ac None None] Checking router: 65d15860-a1d7-449d-b2d9-7210d0a1d10b for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:57:57.133455 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15d6ed4f-e990-4972-97ba-48698aefe4ac None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:57:57.134072 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-15d6ed4f-e990-4972-97ba-48698aefe4ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:57:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:57.155040 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-0fd3891d-51cc-4796-aa91-c6652145c474 admin admin] For port d03b886a-1564-44d9-a5a2-34ff7929ef4b, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=d03b886a-1564-44d9-a5a2-34ff7929ef4b,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:57.156378 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0fd3891d-51cc-4796-aa91-c6652145c474 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:57.169161 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-0fd3891d-51cc-4796-aa91-c6652145c474 admin admin] Calling delete_port for d03b886a-1564-44d9-a5a2-34ff7929ef4b owned by network:router_interface {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:57:57.251066 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-15d6ed4f-e990-4972-97ba-48698aefe4ac None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:57:57.354840 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0fd3891d-51cc-4796-aa91-c6652145c474 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:57.379730 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd3891d-51cc-4796-aa91-c6652145c474 admin admin] Pushing event deleted for resources: {'Port': ['ID=d03b886a-1564-44d9-a5a2-34ff7929ef4b,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:57.463227 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-15d6ed4f-e990-4972-97ba-48698aefe4ac None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 5, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:57.489270 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15d6ed4f-e990-4972-97ba-48698aefe4ac None None] The sync data for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi is: [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:51:45Z', 'revision_number': 4, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'b90c7b7c-6c07-46d3-a05c-f48dfaf5adea', 'name': '', 'network_id': 'ea19090b-8034-4904-8b6c-1752befe0b5a', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'mac_address': 'fa:16:3e:52:bc:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:54Z', 'revision_number': 5, 'project_id': '389c281a19bb49e583633f57108f7f69', 'subnets': [{'id': '8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:57:57.551880 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0fd3891d-51cc-4796-aa91-c6652145c474 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1684491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-473209'] for router_interface, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:57.723882 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1b43715-2d2e-4c64-a2f1-4e67ebca3e42 None None] New status for floating IP f8b3c7bf-cb9f-4d02-9d64-455c864da562: DOWN {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 13:57:57.770456 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0fd3891d-51cc-4796-aa91-c6652145c474 admin admin] Router 97eb221f-bbef-4cab-b393-a7606b8c7477 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:57:57.879736 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0fd3891d-51cc-4796-aa91-c6652145c474 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:57:57.887277 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-0fd3891d-51cc-4796-aa91-c6652145c474 admin admin] 10.222.0.11 "PUT /v2.0/routers/97eb221f-bbef-4cab-b393-a7606b8c7477/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4888389 Nov 21 13:57:57.887499 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57000) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:57.888078 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c135d42e-92ec-40da-a7e1-61475b95ae10 None None] Sync routers for ids ['97eb221f-bbef-4cab-b393-a7606b8c7477'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:57:57.897482 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c135d42e-92ec-40da-a7e1-61475b95ae10 None None] Routers {'97eb221f-bbef-4cab-b393-a7606b8c7477'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:57:57.897999 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-c135d42e-92ec-40da-a7e1-61475b95ae10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:57:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['97eb221f-bbef-4cab-b393-a7606b8c7477'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:57.989326 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Publish callbacks [] for router, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.001519 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-c135d42e-92ec-40da-a7e1-61475b95ae10 None None] Set router 97eb221f-bbef-4cab-b393-a7606b8c7477 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:57:58.089645 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.141903 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Deleting port 7c4354f0-0c69-4a70-b082-dcc2a2112ad7 {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:57:58.142246 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.181251 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-c135d42e-92ec-40da-a7e1-61475b95ae10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38'}], 'enable_snat': True}, 'gw_port_id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:57:57Z', 'revision_number': 5, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port': {'id': '7c4354f0-0c69-4a70-b082-dcc2a2112ad7', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:b6:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'device_owner': 'network:router_gateway', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:55:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:58.208338 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c135d42e-92ec-40da-a7e1-61475b95ae10 None None] Checking router: 97eb221f-bbef-4cab-b393-a7606b8c7477 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:57:58.211187 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57006) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:58.217326 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c135d42e-92ec-40da-a7e1-61475b95ae10 None None] Routers {'97eb221f-bbef-4cab-b393-a7606b8c7477'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:57:58.218854 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-c135d42e-92ec-40da-a7e1-61475b95ae10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:57:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['97eb221f-bbef-4cab-b393-a7606b8c7477'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:58.235970 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] For port 7c4354f0-0c69-4a70-b082-dcc2a2112ad7, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=7c4354f0-0c69-4a70-b082-dcc2a2112ad7,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:58.236364 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.249894 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Calling delete_port for 7c4354f0-0c69-4a70-b082-dcc2a2112ad7 owned by network:router_gateway {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:57:58.274839 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-537de69a-14d4-456f-9464-75b96498c3d0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.300891 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-537de69a-14d4-456f-9464-75b96498c3d0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.308581 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-c135d42e-92ec-40da-a7e1-61475b95ae10 None None] Set router 97eb221f-bbef-4cab-b393-a7606b8c7477 gateway port host: None {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:57:58.351576 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-537de69a-14d4-456f-9464-75b96498c3d0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.355012 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-537de69a-14d4-456f-9464-75b96498c3d0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.356481 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-537de69a-14d4-456f-9464-75b96498c3d0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "DELETE /v2.0/security-groups/fe1f10dd-0418-4dff-bc67-cd614e6291d3 HTTP/1.1" status: 204 len: 168 time: 0.1442454 Nov 21 13:57:58.363033 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57008) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:58.364948 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-c135d42e-92ec-40da-a7e1-61475b95ae10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:57:58Z', 'revision_number': 6, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port_host': None}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:58.373078 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-537de69a-14d4-456f-9464-75b96498c3d0 tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe1f10dd-0418-4dff-bc67-cd614e6291d3,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:58.391284 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.api.v2.resource [None req-d39b08ec-6872-44ea-98ec-1e75d402fe6c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] show failed (client error): The resource could not be found. Nov 21 13:57:58.395248 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-d39b08ec-6872-44ea-98ec-1e75d402fe6c tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "GET /v2.0/security-groups/fe1f10dd-0418-4dff-bc67-cd614e6291d3 HTTP/1.1" status: 404 len: 347 time: 0.0318570 Nov 21 13:57:58.395481 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57010) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:58.400699 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c135d42e-92ec-40da-a7e1-61475b95ae10 None None] The sync data for ids ['97eb221f-bbef-4cab-b393-a7606b8c7477'] in dv-cinder-768458-12-iscsi is: [{'id': '97eb221f-bbef-4cab-b393-a7606b8c7477', 'name': 'tempest-TestMinimumBasicScenario-155017918-router', 'tenant_id': '406bef8592334a749f671da6881b0cf5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:54:58Z', 'updated_at': '2021-11-21T13:57:58Z', 'revision_number': 6, 'project_id': '406bef8592334a749f671da6881b0cf5', 'gw_port_host': None}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:57:58.560880 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.589777 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Pushing event deleted for resources: {'Port': ['ID=7c4354f0-0c69-4a70-b082-dcc2a2112ad7,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:58.599117 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-da5f4e40-460f-4042-b24e-d14b0e8ccf2e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Deleting port 0880122b-f282-4b3c-884b-3b040afb4b37 {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:57:58.599444 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-da5f4e40-460f-4042-b24e-d14b0e8ccf2e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.695613 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-471003'] for router_gateway, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.815174 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-da5f4e40-460f-4042-b24e-d14b0e8ccf2e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.815500 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-da5f4e40-460f-4042-b24e-d14b0e8ccf2e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.827151 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-470817', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-58426'] for router, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.832206 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.833812 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-da5f4e40-460f-4042-b24e-d14b0e8ccf2e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Calling delete_port for 0880122b-f282-4b3c-884b-3b040afb4b37 owned by network:floatingip {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:57:58.928367 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-470840'] for router, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.928907 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 97eb221f-bbef-4cab-b393-a7606b8c7477 {{(pid=109040) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 21 13:57:58.941330 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] Publish callbacks [] for router, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:58.942534 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-cbdb699e-ed4c-4166-a4af-ed089449b949 admin admin] 10.222.0.11 "DELETE /v2.0/routers/97eb221f-bbef-4cab-b393-a7606b8c7477 HTTP/1.1" status: 204 len: 168 time: 1.0540888 Nov 21 13:57:58.945151 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57012) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:58.990557 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_v2 [None req-d28b5cd8-0420-4bc2-95f7-589c172d4a11 admin admin] Deleting subnet 7cdb43d5-ad8a-4fcf-8b29-113b86f21514 {{(pid=109041) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 13:57:58.993951 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d28b5cd8-0420-4bc2-95f7-589c172d4a11 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.027772 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-da5f4e40-460f-4042-b24e-d14b0e8ccf2e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.028934 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d28b5cd8-0420-4bc2-95f7-589c172d4a11 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4028984'] for subnet, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.066187 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 8f627980-8d41-4f62-bfa8-683b4cdc0b4c no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:57:59.089677 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: 8f627980-8d41-4f62-bfa8-683b4cdc0b4c {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:57:59.090108 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 8f627980-8d41-4f62-bfa8-683b4cdc0b4c not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:57:59.090632 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 0f9a92e8-efd7-45cc-b13f-25658f0506ad no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:57:59.112937 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: 0f9a92e8-efd7-45cc-b13f-25658f0506ad {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:57:59.113434 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 0f9a92e8-efd7-45cc-b13f-25658f0506ad not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:57:59.144508 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d28b5cd8-0420-4bc2-95f7-589c172d4a11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.203136 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d28b5cd8-0420-4bc2-95f7-589c172d4a11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3086848', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261005199'] for subnet, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.233327 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d28b5cd8-0420-4bc2-95f7-589c172d4a11 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7cdb43d5-ad8a-4fcf-8b29-113b86f21514,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:59.244937 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d28b5cd8-0420-4bc2-95f7-589c172d4a11 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.246109 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-033dad13-ae73-4095-ae0b-3dc59e7bb176 None None] Network 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:57:59.251964 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-d28b5cd8-0420-4bc2-95f7-589c172d4a11 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/7cdb43d5-ad8a-4fcf-8b29-113b86f21514 HTTP/1.1" status: 204 len: 168 time: 0.3029485 Nov 21 13:57:59.252689 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57014) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:57:59.268294 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da5f4e40-460f-4042-b24e-d14b0e8ccf2e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Pushing event deleted for resources: {'Port': ['ID=0880122b-f282-4b3c-884b-3b040afb4b37,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:59.335446 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.341712 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-da5f4e40-460f-4042-b24e-d14b0e8ccf2e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks [] for floatingip, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.344445 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-da5f4e40-460f-4042-b24e-d14b0e8ccf2e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.348114 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-da5f4e40-460f-4042-b24e-d14b0e8ccf2e tempest-AttachVolumeTestJSON-1802686741 tempest-AttachVolumeTestJSON-1802686741-project] 10.222.0.11 "DELETE /v2.0/floatingips/f8b3c7bf-cb9f-4d02-9d64-455c864da562 HTTP/1.1" status: 204 len: 168 time: 0.9493132 Nov 21 13:57:59.401650 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Deleting port 22d2f290-de3d-4780-8579-ec2027409661 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:57:59.402044 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.475143 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a25af16b-80cb-452d-a926-2fca0d7ecbac None None] DHCP port deletion for 34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 request from dv-cinder-768458-12-iscsi {{(pid=109042) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 21 13:57:59.534735 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-a25af16b-80cb-452d-a926-2fca0d7ecbac None None] Deleting port 22d2f290-de3d-4780-8579-ec2027409661 {{(pid=109042) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:57:59.535184 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-a25af16b-80cb-452d-a926-2fca0d7ecbac None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.601293 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-a25af16b-80cb-452d-a926-2fca0d7ecbac None None] For port 22d2f290-de3d-4780-8579-ec2027409661, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=22d2f290-de3d-4780-8579-ec2027409661,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:59.601701 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-a25af16b-80cb-452d-a926-2fca0d7ecbac None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.616186 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-a25af16b-80cb-452d-a926-2fca0d7ecbac None None] Calling delete_port for 22d2f290-de3d-4780-8579-ec2027409661 owned by network:dhcp {{(pid=109042) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:57:59.724858 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] For port 22d2f290-de3d-4780-8579-ec2027409661, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=22d2f290-de3d-4780-8579-ec2027409661,segment=NetworkSegment(4b6f9b23-2ba5-4aaf-ba35-6a043045eacf),segment_id=4b6f9b23-2ba5-4aaf-ba35-6a043045eacf)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:57:59.725228 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.738747 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Calling delete_port for 22d2f290-de3d-4780-8579-ec2027409661 owned by network:dhcp {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:57:59.742098 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-a25af16b-80cb-452d-a926-2fca0d7ecbac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855'] for port, after_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.766823 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a25af16b-80cb-452d-a926-2fca0d7ecbac None None] Pushing event deleted for resources: {'Port': ['ID=22d2f290-de3d-4780-8579-ec2027409661,revision_number=None']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:59.770370 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a25af16b-80cb-452d-a926-2fca0d7ecbac None None] No DVR routers for this DVR port 22d2f290-de3d-4780-8579-ec2027409661 on host dv-cinder-768458-12-iscsi {{(pid=109042) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:57:59.816403 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.844907 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Pushing event deleted for resources: {'Port': ['ID=22d2f290-de3d-4780-8579-ec2027409661,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:57:59.848458 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] No DVR routers for this DVR port 22d2f290-de3d-4780-8579-ec2027409661 on host dv-cinder-768458-12-iscsi {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:57:59.917609 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.936757 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9']}} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:59.945754 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf') {'for_net_delete': True} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:59.946050 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4b6f9b23-2ba5-4aaf-ba35-6a043045eacf') {} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:57:59.955515 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4028979'] for segment, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.968823 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.974572 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Releasing vlan 504 on physical network physnet1 to pool {{(pid=109041) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 13:57:59.974958 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3087018'] for segment, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: self.session.flush() Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: self.session.flush() Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: self.session.flush() Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: self.session.flush() Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: Traceback (most recent call last): Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: timer() Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: cb(*args, **kw) Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: return func(*args, **kwargs) Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: self._notify() Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: self.callback(batched_events) Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: event.method(event) Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: return f(self, *a, **k) Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._get(url).json() Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: return self.request(url, 'GET', **kwargs) Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 13:57:59.976613 dv-cinder-768458-12-iscsi neutron-server[109041]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 13:58:00.031163 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:00.036060 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:00.039343 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] 10.222.0.11 "DELETE /v2.0/networks/34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9 HTTP/1.1" status: 204 len: 168 time: 0.7856398 Nov 21 13:58:00.042456 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57020) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:00.051292 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63160b8a-d833-4070-8f24-dcd401e007af admin admin] Pushing event deleted for resources: {'Network': ['ID=34d1503d-ef3f-4ea6-a29f-1ccfc49c25d9,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:00.205304 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-dc788023-6799-47c6-bb78-5233742487d5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:00.380975 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-df013472-901d-472f-9b2d-eae140cde1f5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-473237'] for router_interface, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:00.398888 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 22d2f290-de3d-4780-8579-ec2027409661 no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:00.422006 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: 22d2f290-de3d-4780-8579-ec2027409661 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:00.422354 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 22d2f290-de3d-4780-8579-ec2027409661 not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:00.422773 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 7c4354f0-0c69-4a70-b082-dcc2a2112ad7 no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:00.566691 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: 7c4354f0-0c69-4a70-b082-dcc2a2112ad7 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:00.567044 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 7c4354f0-0c69-4a70-b082-dcc2a2112ad7 not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:00.567459 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device d03b886a-1564-44d9-a5a2-34ff7929ef4b no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:00.587790 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: d03b886a-1564-44d9-a5a2-34ff7929ef4b {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:00.588180 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device d03b886a-1564-44d9-a5a2-34ff7929ef4b not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:00.643667 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-df013472-901d-472f-9b2d-eae140cde1f5 admin admin] Deleting port e6e9b263-663a-4c89-936d-c14636fe4f02 {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:00.644040 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-df013472-901d-472f-9b2d-eae140cde1f5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:00.720595 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-df013472-901d-472f-9b2d-eae140cde1f5 admin admin] For port e6e9b263-663a-4c89-936d-c14636fe4f02, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=e6e9b263-663a-4c89-936d-c14636fe4f02,segment=NetworkSegment(78a76216-9ccc-495d-b652-9eac2e50acde),segment_id=78a76216-9ccc-495d-b652-9eac2e50acde)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:00.721000 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-df013472-901d-472f-9b2d-eae140cde1f5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:00.735782 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-df013472-901d-472f-9b2d-eae140cde1f5 admin admin] Calling delete_port for e6e9b263-663a-4c89-936d-c14636fe4f02 owned by network:router_interface {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:00.922185 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-df013472-901d-472f-9b2d-eae140cde1f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:00.954571 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df013472-901d-472f-9b2d-eae140cde1f5 admin admin] Pushing event deleted for resources: {'Port': ['ID=e6e9b263-663a-4c89-936d-c14636fe4f02,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:01.111722 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-df013472-901d-472f-9b2d-eae140cde1f5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1684491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-473209'] for router_interface, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:01.319590 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-df013472-901d-472f-9b2d-eae140cde1f5 admin admin] Router 705abd5c-0912-4311-842a-c2f3c483d3eb has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:58:01.427453 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-df013472-901d-472f-9b2d-eae140cde1f5 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:58:01.432417 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-df013472-901d-472f-9b2d-eae140cde1f5 admin admin] 10.222.0.11 "PUT /v2.0/routers/705abd5c-0912-4311-842a-c2f3c483d3eb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.3889284 Nov 21 13:58:01.434846 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57028) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:01.437504 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-834af801-2887-436a-b7cc-76536e929d51 None None] Sync routers for ids ['705abd5c-0912-4311-842a-c2f3c483d3eb'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:58:01.447746 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-834af801-2887-436a-b7cc-76536e929d51 None None] Routers {'705abd5c-0912-4311-842a-c2f3c483d3eb'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:01.448402 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-834af801-2887-436a-b7cc-76536e929d51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:57:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['705abd5c-0912-4311-842a-c2f3c483d3eb'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:01.535459 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Publish callbacks [] for router, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:01.550134 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-834af801-2887-436a-b7cc-76536e929d51 None None] Set router 705abd5c-0912-4311-842a-c2f3c483d3eb gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:01.634184 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:01.691732 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Deleting port d30bde6b-6556-4178-8b2a-516a2976ea2e {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:01.692099 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:01.730703 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-834af801-2887-436a-b7cc-76536e929d51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'name': 'tempest-TestMinimumBasicScenario-1808110943-router', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87'}], 'enable_snat': True}, 'gw_port_id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:58:00Z', 'revision_number': 5, 'project_id': '8a427df7aae04fb486d16dc21e1096f1', 'gw_port': {'id': 'd30bde6b-6556-4178-8b2a-516a2976ea2e', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:ba:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:55:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:01.761095 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-834af801-2887-436a-b7cc-76536e929d51 None None] Checking router: 705abd5c-0912-4311-842a-c2f3c483d3eb for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:58:01.770747 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-834af801-2887-436a-b7cc-76536e929d51 None None] Routers {'705abd5c-0912-4311-842a-c2f3c483d3eb'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:01.771353 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-834af801-2887-436a-b7cc-76536e929d51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:57:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['705abd5c-0912-4311-842a-c2f3c483d3eb'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:01.776330 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] For port d30bde6b-6556-4178-8b2a-516a2976ea2e, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=d30bde6b-6556-4178-8b2a-516a2976ea2e,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:01.776726 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:01.789956 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Calling delete_port for d30bde6b-6556-4178-8b2a-516a2976ea2e owned by network:router_gateway {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:01.858264 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-834af801-2887-436a-b7cc-76536e929d51 None None] Set router 705abd5c-0912-4311-842a-c2f3c483d3eb gateway port host: None {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:01.910285 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-834af801-2887-436a-b7cc-76536e929d51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'name': 'tempest-TestMinimumBasicScenario-1808110943-router', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:58:01Z', 'revision_number': 6, 'project_id': '8a427df7aae04fb486d16dc21e1096f1', 'gw_port_host': None}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:01.940115 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-834af801-2887-436a-b7cc-76536e929d51 None None] The sync data for ids ['705abd5c-0912-4311-842a-c2f3c483d3eb'] in dv-cinder-768458-12-iscsi is: [{'id': '705abd5c-0912-4311-842a-c2f3c483d3eb', 'name': 'tempest-TestMinimumBasicScenario-1808110943-router', 'tenant_id': '8a427df7aae04fb486d16dc21e1096f1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:55:03Z', 'updated_at': '2021-11-21T13:58:01Z', 'revision_number': 6, 'project_id': '8a427df7aae04fb486d16dc21e1096f1', 'gw_port_host': None}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:58:01.969334 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:01.997892 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Pushing event deleted for resources: {'Port': ['ID=d30bde6b-6556-4178-8b2a-516a2976ea2e,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:02.061382 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-471003'] for router_gateway, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.146906 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-470817', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-58426'] for router, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.148985 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.190352 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-470840'] for router, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.190833 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 705abd5c-0912-4311-842a-c2f3c483d3eb {{(pid=109040) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 21 13:58:02.195151 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] Publish callbacks [] for router, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.196302 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-c92a2a77-8821-4550-b5a7-1607971c6f34 admin admin] 10.222.0.11 "DELETE /v2.0/routers/705abd5c-0912-4311-842a-c2f3c483d3eb HTTP/1.1" status: 204 len: 168 time: 0.7605536 Nov 21 13:58:02.198868 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57040) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:02.244597 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_v2 [None req-6a1c909a-b4a3-4b1b-a392-27060d898d66 admin admin] Deleting subnet 878df1eb-5cc7-403d-97b2-590aeb393b7b {{(pid=109040) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 13:58:02.247509 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6a1c909a-b4a3-4b1b-a392-27060d898d66 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.290009 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6a1c909a-b4a3-4b1b-a392-27060d898d66 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-261998919'] for subnet, precommit_delete_associations {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.407066 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6a1c909a-b4a3-4b1b-a392-27060d898d66 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.569157 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8cb81131-e7ec-413e-87ef-5f837a951ba4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.668405 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6a1c909a-b4a3-4b1b-a392-27060d898d66 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2298272', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261670867'] for subnet, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.693507 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a1c909a-b4a3-4b1b-a392-27060d898d66 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=878df1eb-5cc7-403d-97b2-590aeb393b7b,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:02.699014 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6a1c909a-b4a3-4b1b-a392-27060d898d66 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.702993 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-6a1c909a-b4a3-4b1b-a392-27060d898d66 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/878df1eb-5cc7-403d-97b2-590aeb393b7b HTTP/1.1" status: 204 len: 168 time: 0.5025418 Nov 21 13:58:02.705638 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57042) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:02.708659 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a180b9c4-49c7-4518-bc8f-fa67f68acf3b None None] Network 08c5111b-0961-44c1-9cc0-edd7033d9b9c requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:58:02.779718 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device e6e9b263-663a-4c89-936d-c14636fe4f02 no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:02.785171 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.803028 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: e6e9b263-663a-4c89-936d-c14636fe4f02 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:02.803379 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device e6e9b263-663a-4c89-936d-c14636fe4f02 not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:02.842749 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Deleting port 05847e0e-f0cf-4e7d-ac5d-7e9300972822 {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:02.843131 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.919937 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] For port 05847e0e-f0cf-4e7d-ac5d-7e9300972822, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=05847e0e-f0cf-4e7d-ac5d-7e9300972822,segment=NetworkSegment(78a76216-9ccc-495d-b652-9eac2e50acde),segment_id=78a76216-9ccc-495d-b652-9eac2e50acde)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:02.920839 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:02.928716 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d43b3a2-0770-4d9a-aa3f-d8e9e06a42c6 None None] DHCP port deletion for 08c5111b-0961-44c1-9cc0-edd7033d9b9c request from dv-cinder-768458-12-iscsi {{(pid=109042) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 21 13:58:02.935247 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Calling delete_port for 05847e0e-f0cf-4e7d-ac5d-7e9300972822 owned by network:dhcp {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:02.954302 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57050) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:02.990518 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-4d43b3a2-0770-4d9a-aa3f-d8e9e06a42c6 None None] Deleting port 05847e0e-f0cf-4e7d-ac5d-7e9300972822 {{(pid=109042) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:02.990979 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4d43b3a2-0770-4d9a-aa3f-d8e9e06a42c6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.034633 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.065430 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-4d43b3a2-0770-4d9a-aa3f-d8e9e06a42c6 None None] For port 05847e0e-f0cf-4e7d-ac5d-7e9300972822, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=05847e0e-f0cf-4e7d-ac5d-7e9300972822,segment=NetworkSegment(78a76216-9ccc-495d-b652-9eac2e50acde),segment_id=78a76216-9ccc-495d-b652-9eac2e50acde)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:03.065835 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4d43b3a2-0770-4d9a-aa3f-d8e9e06a42c6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.078343 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] No DVR routers for this DVR port 05847e0e-f0cf-4e7d-ac5d-7e9300972822 on host dv-cinder-768458-12-iscsi {{(pid=109040) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:58:03.080864 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Pushing event deleted for resources: {'Port': ['ID=05847e0e-f0cf-4e7d-ac5d-7e9300972822,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:03.081101 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-4d43b3a2-0770-4d9a-aa3f-d8e9e06a42c6 None None] Calling delete_port for 05847e0e-f0cf-4e7d-ac5d-7e9300972822 owned by network:dhcp {{(pid=109042) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:03.152732 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.168920 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4d43b3a2-0770-4d9a-aa3f-d8e9e06a42c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855'] for port, after_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.177290 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['08c5111b-0961-44c1-9cc0-edd7033d9b9c']}} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:03.187588 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '78a76216-9ccc-495d-b652-9eac2e50acde') {'for_net_delete': True} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:03.187992 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '78a76216-9ccc-495d-b652-9eac2e50acde') {} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:03.194415 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d43b3a2-0770-4d9a-aa3f-d8e9e06a42c6 None None] Pushing event deleted for resources: {'Port': ['ID=05847e0e-f0cf-4e7d-ac5d-7e9300972822,revision_number=None']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:03.197700 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-261998924'] for segment, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.198120 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d43b3a2-0770-4d9a-aa3f-d8e9e06a42c6 None None] No DVR routers for this DVR port 05847e0e-f0cf-4e7d-ac5d-7e9300972822 on host dv-cinder-768458-12-iscsi {{(pid=109042) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:58:03.212852 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.220475 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Releasing vlan 540 on physical network physnet1 to pool {{(pid=109040) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 13:58:03.220863 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2298122'] for segment, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: Traceback (most recent call last): Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: timer() Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: cb(*args, **kw) Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: return func(*args, **kwargs) Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: self._notify() Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: self.callback(batched_events) Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: event.method(event) Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: return f(self, *a, **k) Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._get(url).json() Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: return self.request(url, 'GET', **kwargs) Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 13:58:03.222615 dv-cinder-768458-12-iscsi neutron-server[109040]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 13:58:03.278347 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.285590 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.289032 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] 10.222.0.11 "DELETE /v2.0/networks/08c5111b-0961-44c1-9cc0-edd7033d9b9c HTTP/1.1" status: 204 len: 168 time: 0.5823822 Nov 21 13:58:03.298977 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74854781-3404-4771-aa70-d4429fae0ade admin admin] Pushing event deleted for resources: {'Network': ['ID=08c5111b-0961-44c1-9cc0-edd7033d9b9c,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:03.410181 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57056) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:03.449833 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-24ea5643-a447-4324-9dce-d0c886902eb7 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=406bef8592334a749f671da6881b0cf5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0383980 Nov 21 13:58:03.452262 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57058) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:03.498439 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9eb24a04-9603-4600-971e-7eb22c0e3805 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.523470 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9eb24a04-9603-4600-971e-7eb22c0e3805 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.536280 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d98a4853-b68e-4f93-99e6-81f04b1c3b9f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-473237'] for router_interface, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.570068 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9eb24a04-9603-4600-971e-7eb22c0e3805 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.572707 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9eb24a04-9603-4600-971e-7eb22c0e3805 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.573851 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-9eb24a04-9603-4600-971e-7eb22c0e3805 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/dcfd3018-6236-44ab-a1ee-abdf37bb89a5 HTTP/1.1" status: 204 len: 168 time: 0.1207018 Nov 21 13:58:03.581708 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eb24a04-9603-4600-971e-7eb22c0e3805 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dcfd3018-6236-44ab-a1ee-abdf37bb89a5,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:03.841322 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-d98a4853-b68e-4f93-99e6-81f04b1c3b9f admin admin] Deleting port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:03.841666 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d98a4853-b68e-4f93-99e6-81f04b1c3b9f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.888621 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.904623 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57064) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:03.920788 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [None req-d98a4853-b68e-4f93-99e6-81f04b1c3b9f admin admin] For port b90c7b7c-6c07-46d3-a05c-f48dfaf5adea, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=b90c7b7c-6c07-46d3-a05c-f48dfaf5adea,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:03.921660 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d98a4853-b68e-4f93-99e6-81f04b1c3b9f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:03.933905 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-d98a4853-b68e-4f93-99e6-81f04b1c3b9f admin admin] Calling delete_port for b90c7b7c-6c07-46d3-a05c-f48dfaf5adea owned by network:router_interface {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:03.944720 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-daa6a344-da02-4635-aefa-9e4ad1ecd919 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=8a427df7aae04fb486d16dc21e1096f1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0382817 Nov 21 13:58:03.947180 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57066) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:03.994423 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ed313332-04aa-4643-80ad-3f209bf82a52 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:04.016141 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ed313332-04aa-4643-80ad-3f209bf82a52 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:04.061251 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ed313332-04aa-4643-80ad-3f209bf82a52 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:04.064745 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ed313332-04aa-4643-80ad-3f209bf82a52 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:04.066053 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-ed313332-04aa-4643-80ad-3f209bf82a52 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/fe1b9d65-1974-4425-b207-39e3303b52f2 HTTP/1.1" status: 204 len: 168 time: 0.1179028 Nov 21 13:58:04.074321 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed313332-04aa-4643-80ad-3f209bf82a52 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe1b9d65-1974-4425-b207-39e3303b52f2,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:04.124253 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d98a4853-b68e-4f93-99e6-81f04b1c3b9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:04.150247 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d98a4853-b68e-4f93-99e6-81f04b1c3b9f admin admin] Pushing event deleted for resources: {'Port': ['ID=b90c7b7c-6c07-46d3-a05c-f48dfaf5adea,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:04.322693 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d98a4853-b68e-4f93-99e6-81f04b1c3b9f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1684491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-473209'] for router_interface, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:04.490271 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device d30bde6b-6556-4178-8b2a-516a2976ea2e no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:04.510185 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: d30bde6b-6556-4178-8b2a-516a2976ea2e {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:04.510533 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device d30bde6b-6556-4178-8b2a-516a2976ea2e not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:04.510939 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 05847e0e-f0cf-4e7d-ac5d-7e9300972822 no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:04.532189 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: 05847e0e-f0cf-4e7d-ac5d-7e9300972822 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:04.532533 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 05847e0e-f0cf-4e7d-ac5d-7e9300972822 not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:04.546724 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d98a4853-b68e-4f93-99e6-81f04b1c3b9f admin admin] Router 65d15860-a1d7-449d-b2d9-7210d0a1d10b has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:58:04.649076 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d98a4853-b68e-4f93-99e6-81f04b1c3b9f admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:58:04.655554 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-d98a4853-b68e-4f93-99e6-81f04b1c3b9f admin admin] 10.222.0.11 "PUT /v2.0/routers/65d15860-a1d7-449d-b2d9-7210d0a1d10b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6994288 Nov 21 13:58:04.656594 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57070) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:04.657773 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f087528e-7a48-4b29-9787-a58ec2a57182 None None] Sync routers for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:58:04.667283 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f087528e-7a48-4b29-9787-a58ec2a57182 None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:04.667912 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-f087528e-7a48-4b29-9787-a58ec2a57182 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:58:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:04.757570 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Publish callbacks [] for router, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:04.770710 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-f087528e-7a48-4b29-9787-a58ec2a57182 None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:04.855640 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:04.909613 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Deleting port 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:04.910073 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:04.946027 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-f087528e-7a48-4b29-9787-a58ec2a57182 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36'}], 'enable_snat': True}, 'gw_port_id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:58:04Z', 'revision_number': 5, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port': {'id': '4b6ebcd5-75f1-45dd-b6a3-3a4972744dca', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:33:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 48, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:39Z', 'updated_at': '2021-11-21T13:51:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:04.971218 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f087528e-7a48-4b29-9787-a58ec2a57182 None None] Checking router: 65d15860-a1d7-449d-b2d9-7210d0a1d10b for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:58:04.979391 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f087528e-7a48-4b29-9787-a58ec2a57182 None None] Routers {'65d15860-a1d7-449d-b2d9-7210d0a1d10b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:04.980025 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-f087528e-7a48-4b29-9787-a58ec2a57182 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:58:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:04.986378 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] For port 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=4b6ebcd5-75f1-45dd-b6a3-3a4972744dca,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:04.986761 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.000130 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Calling delete_port for 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca owned by network:router_gateway {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:05.075640 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-f087528e-7a48-4b29-9787-a58ec2a57182 None None] Set router 65d15860-a1d7-449d-b2d9-7210d0a1d10b gateway port host: None {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:05.110590 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.143711 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-f087528e-7a48-4b29-9787-a58ec2a57182 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:58:04Z', 'revision_number': 6, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port_host': None}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:05.164295 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.171787 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f087528e-7a48-4b29-9787-a58ec2a57182 None None] The sync data for ids ['65d15860-a1d7-449d-b2d9-7210d0a1d10b'] in dv-cinder-768458-12-iscsi is: [{'id': '65d15860-a1d7-449d-b2d9-7210d0a1d10b', 'name': 'tempest-AttachVolumeTestJSON-2083364250-router', 'tenant_id': '389c281a19bb49e583633f57108f7f69', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:38Z', 'updated_at': '2021-11-21T13:58:04Z', 'revision_number': 6, 'project_id': '389c281a19bb49e583633f57108f7f69', 'gw_port_host': None}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:58:05.195234 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Pushing event deleted for resources: {'Port': ['ID=4b6ebcd5-75f1-45dd-b6a3-3a4972744dca,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:05.255589 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-471003'] for router_gateway, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.341108 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-470817', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-58426'] for router, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.343665 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.385319 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-470840'] for router, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.385986 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 65d15860-a1d7-449d-b2d9-7210d0a1d10b {{(pid=109041) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 21 13:58:05.390820 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] Publish callbacks [] for router, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.391992 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-9ea0fb32-adfc-4a52-a373-2cf8db7948a2 admin admin] 10.222.0.11 "DELETE /v2.0/routers/65d15860-a1d7-449d-b2d9-7210d0a1d10b HTTP/1.1" status: 204 len: 168 time: 0.7344644 Nov 21 13:58:05.394436 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57072) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:05.440721 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_v2 [None req-928e8a16-958a-4dde-92f7-7234bd73fba9 admin admin] Deleting subnet 8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0 {{(pid=109041) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 13:58:05.443657 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-928e8a16-958a-4dde-92f7-7234bd73fba9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.478462 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-928e8a16-958a-4dde-92f7-7234bd73fba9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4028984'] for subnet, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.552807 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-928e8a16-958a-4dde-92f7-7234bd73fba9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.608978 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-928e8a16-958a-4dde-92f7-7234bd73fba9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3086848', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261005199'] for subnet, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.634357 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-928e8a16-958a-4dde-92f7-7234bd73fba9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:05.638963 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-928e8a16-958a-4dde-92f7-7234bd73fba9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.642710 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-928e8a16-958a-4dde-92f7-7234bd73fba9 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/8bcaf58a-3d9c-4bae-8a13-5c3ecd53a0c0 HTTP/1.1" status: 204 len: 168 time: 0.2473314 Nov 21 13:58:05.644232 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39fc40cd-23bd-4151-a7d7-7e1ae8d25364 None None] Network ea19090b-8034-4904-8b6c-1752befe0b5a requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:58:05.645283 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57074) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:05.713940 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.764582 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Deleting port 6ba2a400-da82-40d5-8543-00a95b3ae29e {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:05.765515 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.830478 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] For port 6ba2a400-da82-40d5-8543-00a95b3ae29e, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=6ba2a400-da82-40d5-8543-00a95b3ae29e,segment=NetworkSegment(8f3a2505-9e61-424e-8456-2758b99b070c),segment_id=8f3a2505-9e61-424e-8456-2758b99b070c)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:05.830858 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.842880 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Calling delete_port for 6ba2a400-da82-40d5-8543-00a95b3ae29e owned by network:dhcp {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:05.851785 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.919487 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:05.945667 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Pushing event deleted for resources: {'Port': ['ID=6ba2a400-da82-40d5-8543-00a95b3ae29e,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:05.947621 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] No DVR routers for this DVR port 6ba2a400-da82-40d5-8543-00a95b3ae29e on host dv-cinder-768458-12-iscsi {{(pid=109040) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:58:05.982628 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0616dbd-7db9-4bcb-90f6-6650c75f11a2 None None] DHCP port deletion for ea19090b-8034-4904-8b6c-1752befe0b5a request from dv-cinder-768458-12-iscsi {{(pid=109042) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 21 13:58:06.025681 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:06.045090 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ea19090b-8034-4904-8b6c-1752befe0b5a']}} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:06.054502 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8f3a2505-9e61-424e-8456-2758b99b070c') {'for_net_delete': True} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:06.054801 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8f3a2505-9e61-424e-8456-2758b99b070c') {} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:06.064967 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-261998924'] for segment, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:06.079053 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:06.085373 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Releasing vlan 507 on physical network physnet1 to pool {{(pid=109040) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 13:58:06.085762 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2298122'] for segment, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: Traceback (most recent call last): Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: timer() Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: cb(*args, **kw) Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: return func(*args, **kwargs) Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: self._notify() Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: self.callback(batched_events) Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: event.method(event) Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: return f(self, *a, **k) Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._get(url).json() Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: return self.request(url, 'GET', **kwargs) Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 13:58:06.087448 dv-cinder-768458-12-iscsi neutron-server[109040]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 13:58:06.144671 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:06.149749 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:06.153554 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] 10.222.0.11 "DELETE /v2.0/networks/ea19090b-8034-4904-8b6c-1752befe0b5a HTTP/1.1" status: 204 len: 168 time: 0.5072699 Nov 21 13:58:06.174704 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b355f5af-a0b2-4efa-b7c3-98489074ef8f admin admin] Pushing event deleted for resources: {'Network': ['ID=ea19090b-8034-4904-8b6c-1752befe0b5a,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:06.319868 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57078) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:06.360738 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-6fe43717-fa5f-4f51-90d0-14f902db3da3 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=389c281a19bb49e583633f57108f7f69&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0396397 Nov 21 13:58:06.363047 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57080) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:06.394619 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 6ba2a400-da82-40d5-8543-00a95b3ae29e no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:06.410087 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-900c01b9-fbc0-4047-b58f-63bfd49e116d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:06.418701 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: 6ba2a400-da82-40d5-8543-00a95b3ae29e {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:06.419045 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 6ba2a400-da82-40d5-8543-00a95b3ae29e not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:06.419650 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:06.431346 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-900c01b9-fbc0-4047-b58f-63bfd49e116d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:06.438649 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:06.438989 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 4b6ebcd5-75f1-45dd-b6a3-3a4972744dca not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:06.439390 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device b90c7b7c-6c07-46d3-a05c-f48dfaf5adea no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:06.457599 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: b90c7b7c-6c07-46d3-a05c-f48dfaf5adea {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:06.457954 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device b90c7b7c-6c07-46d3-a05c-f48dfaf5adea not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:06.480926 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-900c01b9-fbc0-4047-b58f-63bfd49e116d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:06.484209 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-900c01b9-fbc0-4047-b58f-63bfd49e116d admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:06.485362 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-900c01b9-fbc0-4047-b58f-63bfd49e116d admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/6a98a60b-a06a-4423-8012-d18fff285196 HTTP/1.1" status: 204 len: 168 time: 0.1213894 Nov 21 13:58:06.493499 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-900c01b9-fbc0-4047-b58f-63bfd49e116d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a98a60b-a06a-4423-8012-d18fff285196,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:07.149083 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57102) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:07.241848 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1976350102-network', 'tenant_id': '48fbf7b5fd2347789241c7658fd6bb83'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:58:07.262762 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Made reservation on behalf of 48fbf7b5fd2347789241c7658fd6bb83 for: {'network': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:58:07.265598 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:07.273753 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:07.345406 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:07.349223 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:07.375974 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] vlan segment allocate from pool success with {'vlan_id': 511, 'physical_network': 'physnet1'} {{(pid=109040) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:58:07.385702 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11093911-4793-47b7-9cc3-82035471327d,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:07.392054 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:07.392405 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.segments_db [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Added segment 008340fd-3a9e-413b-878e-432ef5e7b038 of type vlan for network e593a34f-1f09-493d-aafd-a51b70c22643 Nov 21 13:58:07.429334 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:07.453264 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:07.454174 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:07.454802 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:07.506890 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3566592 Nov 21 13:58:07.509842 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57106) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:07.513250 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7572131-d81a-44e6-a05e-9c7b9633284a admin admin] Pushing event updated for resources: {'Network': ['ID=e593a34f-1f09-493d-aafd-a51b70c22643,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:07.515516 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-0c9d915b-2dfa-417a-bd15-3f5b34c56de4 admin admin] Request body: {'subnet': {'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1976350102-subnet', 'tenant_id': '48fbf7b5fd2347789241c7658fd6bb83', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:58:07.523905 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network e593a34f-1f09-493d-aafd-a51b70c22643 details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:58:07.535692 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c9d915b-2dfa-417a-bd15-3f5b34c56de4 admin admin] Made reservation on behalf of 48fbf7b5fd2347789241c7658fd6bb83 for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:58:07.538023 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0c9d915b-2dfa-417a-bd15-3f5b34c56de4 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-261005224'] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:07.950494 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0c9d915b-2dfa-417a-bd15-3f5b34c56de4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3086915', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-261005206'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:07.997097 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c9d915b-2dfa-417a-bd15-3f5b34c56de4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=19a08397-ab57-46f7-b983-e6a3bc005bc2,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:08.012386 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c9d915b-2dfa-417a-bd15-3f5b34c56de4 admin admin] Checking segment: {'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:58:08.012742 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c9d915b-2dfa-417a-bd15-3f5b34c56de4 admin admin] Network hostable DHCP agents. Network: e593a34f-1f09-493d-aafd-a51b70c22643, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:58:08.028448 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c9d915b-2dfa-417a-bd15-3f5b34c56de4 admin admin] Network e593a34f-1f09-493d-aafd-a51b70c22643 is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:58:08.037366 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-0c9d915b-2dfa-417a-bd15-3f5b34c56de4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, e593a34f-1f09-493d-aafd-a51b70c22643) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:58:08.041823 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c9d915b-2dfa-417a-bd15-3f5b34c56de4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:08.042955 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0c9d915b-2dfa-417a-bd15-3f5b34c56de4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:08.046488 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3a87c9b-2e15-4409-bb96-18c0772a820e None None] Network e593a34f-1f09-493d-aafd-a51b70c22643 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:58:08.065099 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-0c9d915b-2dfa-417a-bd15-3f5b34c56de4 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.5476799 Nov 21 13:58:08.174006 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab86d2f8-0e7b-477f-ac6d-108e45af6b35 None None] Network e593a34f-1f09-493d-aafd-a51b70c22643 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:58:08.472554 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-df292ad4-0a0a-4c77-b9de-c145c7d116aa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:08.473903 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-df292ad4-0a0a-4c77-b9de-c145c7d116aa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/networks?id=e593a34f-1f09-493d-aafd-a51b70c22643 HTTP/1.1" status: 200 len: 815 time: 0.1024034 Nov 21 13:58:08.488233 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-b861fb7a-d404-4c6f-ab93-4d7572e56ddb tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/quotas/48fbf7b5fd2347789241c7658fd6bb83 HTTP/1.1" status: 200 len: 375 time: 0.0087254 Nov 21 13:58:08.518044 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-0b1f8051-6f0c-46b4-a8ca-bf1aa483c087 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=48fbf7b5fd2347789241c7658fd6bb83&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0248933 Nov 21 13:58:08.650430 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-53d6cc93-8e83-4136-a8ab-562c3d05e520 service neutron] 10.222.0.11 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1258090 Nov 21 13:58:08.740684 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-407e4f6b-1372-4f43-9549-c6bd334e26d4 service neutron] 10.222.0.11 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835385 Nov 21 13:58:08.894638 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-feea7ae5-d063-407f-8a80-d437a5a81169 req-15883247-a3f8-4a46-87f5-7c9bf9986003 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 210 time: 0.0277972 Nov 21 13:58:09.830066 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-2f70affb-002f-4c65-886e-bc14648f5775 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:09.831513 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-2f70affb-002f-4c65-886e-bc14648f5775 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "GET /v2.0/networks?id=e593a34f-1f09-493d-aafd-a51b70c22643 HTTP/1.1" status: 200 len: 815 time: 0.1055274 Nov 21 13:58:09.857115 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-23a37599-0cb4-4991-88d2-6a35ff0501fe tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Request body: {'port': {'device_id': '8f927cd1-a768-4be7-9ed5-6ea5ee46da8e', 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643', 'admin_state_up': True, 'tenant_id': '48fbf7b5fd2347789241c7658fd6bb83'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:58:09.972509 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-23a37599-0cb4-4991-88d2-6a35ff0501fe tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Made reservation on behalf of 48fbf7b5fd2347789241c7658fd6bb83 for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:58:09.976044 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-23a37599-0cb4-4991-88d2-6a35ff0501fe tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:09.995358 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dcaa8e19-3d4b-477c-a102-f87d6d6a47a3 req-10ed2754-f259-4170-ad63-6e4c1702567c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 210 time: 0.0344286 Nov 21 13:58:10.112026 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-23a37599-0cb4-4991-88d2-6a35ff0501fe tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Allocated IP 172.20.0.6 (e593a34f-1f09-493d-aafd-a51b70c22643/19a08397-ab57-46f7-b983-e6a3bc005bc2/311b993c-d963-4bbd-9dd2-91f64ff1d918) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:58:10.254764 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-23a37599-0cb4-4991-88d2-6a35ff0501fe tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:10.286884 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-23a37599-0cb4-4991-88d2-6a35ff0501fe tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:10.334860 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-23a37599-0cb4-4991-88d2-6a35ff0501fe tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Network e593a34f-1f09-493d-aafd-a51b70c22643 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:58:10.338040 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-23a37599-0cb4-4991-88d2-6a35ff0501fe tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:58:10.341613 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-23a37599-0cb4-4991-88d2-6a35ff0501fe tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:58:10.363890 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23a37599-0cb4-4991-88d2-6a35ff0501fe tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Pushing event updated for resources: {'Port': ['ID=311b993c-d963-4bbd-9dd2-91f64ff1d918,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:10.398290 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-23a37599-0cb4-4991-88d2-6a35ff0501fe tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:10.398895 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-23a37599-0cb4-4991-88d2-6a35ff0501fe tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:10.414706 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-23a37599-0cb4-4991-88d2-6a35ff0501fe tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5612605 Nov 21 13:58:10.431450 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Request body: {'port': {'device_id': '8f927cd1-a768-4be7-9ed5-6ea5ee46da8e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:58:10.481448 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:10.728142 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 311b993c-d963-4bbd-9dd2-91f64ff1d918 {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:58:10.736293 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:10.749223 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Transition to ACTIVE for port object 311b993c-d963-4bbd-9dd2-91f64ff1d918 will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:58:10.753658 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:10.808261 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Pushing event updated for resources: {'Port': ['ID=311b993c-d963-4bbd-9dd2-91f64ff1d918,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:10.869677 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Attempting to bind port 311b993c-d963-4bbd-9dd2-91f64ff1d918 on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:58:10.870376 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Attempting to bind port 311b993c-d963-4bbd-9dd2-91f64ff1d918 by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:58:10.870376 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Attempting to bind port 311b993c-d963-4bbd-9dd2-91f64ff1d918 on network e593a34f-1f09-493d-aafd-a51b70c22643 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:58:10.875429 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Port 311b993c-d963-4bbd-9dd2-91f64ff1d918 on network e593a34f-1f09-493d-aafd-a51b70c22643 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:58:10.875751 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Attempting to bind port 311b993c-d963-4bbd-9dd2-91f64ff1d918 on network e593a34f-1f09-493d-aafd-a51b70c22643 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:58:10.880481 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 57, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:58:10.880820 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Checking segment: {'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:58:10.881199 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Bound using segment: {'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:58:10.881624 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Bound port: 311b993c-d963-4bbd-9dd2-91f64ff1d918, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:58:10.881974 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:10.941483 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] For port 311b993c-d963-4bbd-9dd2-91f64ff1d918, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:58:10.944418 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] For port 311b993c-d963-4bbd-9dd2-91f64ff1d918, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=311b993c-d963-4bbd-9dd2-91f64ff1d918,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:58:10.948703 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:10.985147 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:10.985760 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:10.987118 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] 10.222.0.50 "PUT /v2.0/ports/311b993c-d963-4bbd-9dd2-91f64ff1d918 HTTP/1.1" status: 200 len: 1093 time: 0.5596025 Nov 21 13:58:10.987549 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8f927cd1-a768-4be7-9ed5-6ea5ee46da8e', 'tag': '311b993c-d963-4bbd-9dd2-91f64ff1d918'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:58:10.989813 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2316adce-ec70-434c-9057-d07d35d79955" -d '{"events": [{"name": "network-changed", "server_uuid": "8f927cd1-a768-4be7-9ed5-6ea5ee46da8e", "tag": "311b993c-d963-4bbd-9dd2-91f64ff1d918"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:58:11.016344 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Pushing event updated for resources: {'Port': ['ID=311b993c-d963-4bbd-9dd2-91f64ff1d918,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:11.023605 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:11.024001 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:11.024341 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:11.024676 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:11.025007 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:11.025338 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:11.026190 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:11.026604 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:11.026937 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:11.027266 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:11.027999 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:11.028339 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6efa2330-6942-498f-b7d9-db2188f5b170 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:11.044883 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:58:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-221ca9e8-5dd6-4621-879f-6a271ffdd8d2 x-openstack-request-id: req-221ca9e8-5dd6-4621-879f-6a271ffdd8d2 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:58:11.045171 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8f927cd1-a768-4be7-9ed5-6ea5ee46da8e", "tag": "311b993c-d963-4bbd-9dd2-91f64ff1d918", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:58:11.045425 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-221ca9e8-5dd6-4621-879f-6a271ffdd8d2 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:58:11.045821 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8f927cd1-a768-4be7-9ed5-6ea5ee46da8e', 'tag': '311b993c-d963-4bbd-9dd2-91f64ff1d918', 'status': 'completed', 'code': 200} Nov 21 13:58:11.107306 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-57e1314c-6535-4e40-8ce4-f8d637d11c45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:11.108834 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-57e1314c-6535-4e40-8ce4-f8d637d11c45 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=48fbf7b5fd2347789241c7658fd6bb83&device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 1096 time: 0.0747342 Nov 21 13:58:11.136323 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b40c4f8c-49f8-4b47-a145-3c8900f30fbb req-92cfc828-d96b-4421-9345-56b4e46e523e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:11.137745 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b40c4f8c-49f8-4b47-a145-3c8900f30fbb req-92cfc828-d96b-4421-9345-56b4e46e523e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 943 time: 0.0630653 Nov 21 13:58:11.165973 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-3e7fa8e6-da10-42f3-b5ea-3493713cda75 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=311b993c-d963-4bbd-9dd2-91f64ff1d918 HTTP/1.1" status: 200 len: 217 time: 0.0449154 Nov 21 13:58:11.241119 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-b5c5b0b0-863d-4421-9464-d7e89a17a15b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:11.242582 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-b5c5b0b0-863d-4421-9464-d7e89a17a15b service neutron] 10.222.0.50 "GET /v2.0/subnets?id=19a08397-ab57-46f7-b983-e6a3bc005bc2 HTTP/1.1" status: 200 len: 855 time: 0.0613954 Nov 21 13:58:11.246056 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b40c4f8c-49f8-4b47-a145-3c8900f30fbb req-c208b35f-034d-4bd1-a270-86e0053dbc7e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0824013 Nov 21 13:58:11.275721 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-f02bfd78-7538-4395-b199-00c74db41821 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=e593a34f-1f09-493d-aafd-a51b70c22643&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0240855 Nov 21 13:58:11.367937 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-2a3a6971-1a83-429b-ac1d-8dc0b83420f3 service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842555 Nov 21 13:58:11.464899 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ea7ab7e2-3c55-4faa-b932-6edd88ae4f4f req-b5fd7eb1-3fe9-4d55-827a-3556212d7255 service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0891526 Nov 21 13:58:11.555196 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2316adce-ec70-434c-9057-d07d35d79955 req-cbb11c78-2249-4cc5-b759-73aed42504af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:11.556686 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2316adce-ec70-434c-9057-d07d35d79955 req-cbb11c78-2249-4cc5-b759-73aed42504af service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=48fbf7b5fd2347789241c7658fd6bb83&device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 1096 time: 0.0409667 Nov 21 13:58:11.651299 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2316adce-ec70-434c-9057-d07d35d79955 req-2f6d83f4-17fe-4b77-9c8f-4b9911f1c3c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:11.652799 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2316adce-ec70-434c-9057-d07d35d79955 req-2f6d83f4-17fe-4b77-9c8f-4b9911f1c3c8 service neutron] 10.222.0.50 "GET /v2.0/networks?id=e593a34f-1f09-493d-aafd-a51b70c22643 HTTP/1.1" status: 200 len: 916 time: 0.0850616 Nov 21 13:58:11.702139 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2316adce-ec70-434c-9057-d07d35d79955 req-d3d0a24c-a632-4c9d-b6f4-7303d108df3a service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=311b993c-d963-4bbd-9dd2-91f64ff1d918 HTTP/1.1" status: 200 len: 217 time: 0.0349834 Nov 21 13:58:11.751607 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2316adce-ec70-434c-9057-d07d35d79955 req-33ad34c2-52d8-406f-b9bc-6e4c8c0642fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:11.753026 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2316adce-ec70-434c-9057-d07d35d79955 req-33ad34c2-52d8-406f-b9bc-6e4c8c0642fc service neutron] 10.222.0.50 "GET /v2.0/subnets?id=19a08397-ab57-46f7-b983-e6a3bc005bc2 HTTP/1.1" status: 200 len: 855 time: 0.0426846 Nov 21 13:58:11.788184 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2316adce-ec70-434c-9057-d07d35d79955 req-0a3b4988-8a98-4987-ba6c-19ed622524cc service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=e593a34f-1f09-493d-aafd-a51b70c22643&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0272372 Nov 21 13:58:11.876305 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2316adce-ec70-434c-9057-d07d35d79955 req-7bd603e8-333d-4368-8d4e-151dcaa7db60 service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0797265 Nov 21 13:58:11.965730 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2316adce-ec70-434c-9057-d07d35d79955 req-83bb62a3-f14c-4ef0-9d83-02306ce128f5 service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819242 Nov 21 13:58:12.367280 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316fcdae-70ef-459d-89f1-185294a0ce72 req-85c80c79-e431-4f29-b271-bf072f55c305 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:12.368798 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-316fcdae-70ef-459d-89f1-185294a0ce72 req-85c80c79-e431-4f29-b271-bf072f55c305 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 943 time: 0.0513678 Nov 21 13:58:12.419697 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-316fcdae-70ef-459d-89f1-185294a0ce72 req-dceac37b-333e-4999-9e65-417e18ffc1b6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446348 Nov 21 13:58:13.111776 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 311b993c-d963-4bbd-9dd2-91f64ff1d918 details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:58:13.201066 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 311b993c-d963-4bbd-9dd2-91f64ff1d918, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=311b993c-d963-4bbd-9dd2-91f64ff1d918,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:13.212201 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '311b993c-d963-4bbd-9dd2-91f64ff1d918', 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643', 'port_id': '311b993c-d963-4bbd-9dd2-91f64ff1d918', 'mac_address': 'fa:16:3e:2c:5c:ba', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 511, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '19a08397-ab57-46f7-b983-e6a3bc005bc2', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:58:13.251693 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:13.263900 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 311b993c-d963-4bbd-9dd2-91f64ff1d918 {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:58:13.282632 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 311b993c-d963-4bbd-9dd2-91f64ff1d918, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=311b993c-d963-4bbd-9dd2-91f64ff1d918,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:13.288007 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:13.333968 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=311b993c-d963-4bbd-9dd2-91f64ff1d918,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:13.534971 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0727a460-7213-4f73-a5e1-8c600b480fec req-e55d320d-7ce8-4a1d-a44e-ea286bb601d6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:13.536474 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0727a460-7213-4f73-a5e1-8c600b480fec req-e55d320d-7ce8-4a1d-a44e-ea286bb601d6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 944 time: 0.0490401 Nov 21 13:58:13.542593 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['311b993c-d963-4bbd-9dd2-91f64ff1d918'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:58:13.583618 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0727a460-7213-4f73-a5e1-8c600b480fec req-2eea2492-9038-4999-8cb3-c283c43f73ba tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411901 Nov 21 13:58:14.694960 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a4887f-a866-48b4-8001-4d68e695e891 req-66433d64-19ff-4839-bf38-b463922a2be4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:14.696451 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-88a4887f-a866-48b4-8001-4d68e695e891 req-66433d64-19ff-4839-bf38-b463922a2be4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 944 time: 0.0473483 Nov 21 13:58:14.742242 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-88a4887f-a866-48b4-8001-4d68e695e891 req-b3f4b733-ca87-46a1-800c-756d93716870 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399697 Nov 21 13:58:15.110089 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 311b993c-d963-4bbd-9dd2-91f64ff1d918 up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:58:15.157680 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port 311b993c-d963-4bbd-9dd2-91f64ff1d918 completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:58:15.161519 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 311b993c-d963-4bbd-9dd2-91f64ff1d918 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:58:15.161883 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:15.235270 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:15.259720 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f927cd1-a768-4be7-9ed5-6ea5ee46da8e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '311b993c-d963-4bbd-9dd2-91f64ff1d918'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:58:15.261951 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3a3318b9-5ec4-4c90-bbd7-e3e8fa41de5e" -d '{"events": [{"server_uuid": "8f927cd1-a768-4be7-9ed5-6ea5ee46da8e", "name": "network-vif-plugged", "status": "completed", "tag": "311b993c-d963-4bbd-9dd2-91f64ff1d918"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:58:15.395530 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:58:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aad4378c-7d39-4224-81fb-6f26084b57e3 x-openstack-request-id: req-aad4378c-7d39-4224-81fb-6f26084b57e3 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:58:15.395763 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f927cd1-a768-4be7-9ed5-6ea5ee46da8e", "name": "network-vif-plugged", "status": "completed", "tag": "311b993c-d963-4bbd-9dd2-91f64ff1d918", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:58:15.396015 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-aad4378c-7d39-4224-81fb-6f26084b57e3 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:58:15.396400 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f927cd1-a768-4be7-9ed5-6ea5ee46da8e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '311b993c-d963-4bbd-9dd2-91f64ff1d918', 'code': 200} Nov 21 13:58:15.399903 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 311b993c-d963-4bbd-9dd2-91f64ff1d918, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=311b993c-d963-4bbd-9dd2-91f64ff1d918,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:15.404779 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:15.451370 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=311b993c-d963-4bbd-9dd2-91f64ff1d918,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:15.479914 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51418508-6802-4280-b1e6-c77d1ffc49af req-c4ae33bc-37a8-4895-ac09-3a3c9d29d9d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:15.481418 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-51418508-6802-4280-b1e6-c77d1ffc49af req-c4ae33bc-37a8-4895-ac09-3a3c9d29d9d2 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 1098 time: 0.0394716 Nov 21 13:58:15.525135 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-51418508-6802-4280-b1e6-c77d1ffc49af req-08f6a6a9-fd8c-4267-a879-e1793c997e72 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0361619 Nov 21 13:58:15.853856 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced5c28d-fdf7-4f70-a5c4-08db3e1c1188 req-1956ac36-9b87-4ce6-9871-b8259c7ffaa7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:15.855271 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ced5c28d-fdf7-4f70-a5c4-08db3e1c1188 req-1956ac36-9b87-4ce6-9871-b8259c7ffaa7 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 945 time: 0.0466044 Nov 21 13:58:15.906451 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ced5c28d-fdf7-4f70-a5c4-08db3e1c1188 req-ce3571d0-5ad1-4e44-8556-0ed626cdd221 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446184 Nov 21 13:58:17.023471 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36c15fad-1269-40a9-aeb4-2db21bb6f93c req-9407322f-7939-4355-8260-00b0f8623850 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:17.024914 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-36c15fad-1269-40a9-aeb4-2db21bb6f93c req-9407322f-7939-4355-8260-00b0f8623850 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 945 time: 0.0511823 Nov 21 13:58:17.070448 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-36c15fad-1269-40a9-aeb4-2db21bb6f93c req-6b7f2d04-f9d2-40a1-a28f-1770ecc16201 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397501 Nov 21 13:58:22.590580 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:25.246217 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-25220e31-d3d0-4d06-965e-2272ab6d8a15 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:25.247655 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-25220e31-d3d0-4d06-965e-2272ab6d8a15 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/networks?id=e593a34f-1f09-493d-aafd-a51b70c22643 HTTP/1.1" status: 200 len: 815 time: 0.1029685 Nov 21 13:58:25.263195 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-5d79cd65-e809-48de-bffa-3e0d0c03c510 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/quotas/48fbf7b5fd2347789241c7658fd6bb83 HTTP/1.1" status: 200 len: 375 time: 0.0089180 Nov 21 13:58:25.312038 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-cd3bfb0b-50cb-4c5e-9358-d2611f7e6963 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=48fbf7b5fd2347789241c7658fd6bb83&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0435119 Nov 21 13:58:25.402533 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-92c4a130-c8a8-4e28-b38a-03bee20255a6 service neutron] 10.222.0.11 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0797369 Nov 21 13:58:25.494496 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-4bbc6410-3eed-4328-bd8a-bc3a8c127f2b service neutron] 10.222.0.11 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851269 Nov 21 13:58:25.654345 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-44e75575-9943-474d-9550-297552e4a4b5 req-aa5154b9-99aa-4059-9cfa-220754e7fbf6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 210 time: 0.0256221 Nov 21 13:58:26.601505 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-69fb9826-0699-4a91-8bff-7a030128648f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:26.602832 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-69fb9826-0699-4a91-8bff-7a030128648f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "GET /v2.0/networks?id=e593a34f-1f09-493d-aafd-a51b70c22643 HTTP/1.1" status: 200 len: 815 time: 0.1010134 Nov 21 13:58:26.620483 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-6a3e6027-525c-475e-800b-2d6515cc512f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Request body: {'port': {'device_id': '23e6a833-20e6-4882-89ae-bd33ce5e4b48', 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643', 'admin_state_up': True, 'tenant_id': '48fbf7b5fd2347789241c7658fd6bb83'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:58:26.760287 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-408e8930-a338-45a0-99ab-0b4d276280ab req-36bd86b7-47be-4803-8d2b-682b3c281d06 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 210 time: 0.0297384 Nov 21 13:58:26.760998 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-6a3e6027-525c-475e-800b-2d6515cc512f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Made reservation on behalf of 48fbf7b5fd2347789241c7658fd6bb83 for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:58:26.764318 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-6a3e6027-525c-475e-800b-2d6515cc512f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:26.886932 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-6a3e6027-525c-475e-800b-2d6515cc512f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Allocated IP 172.20.0.10 (e593a34f-1f09-493d-aafd-a51b70c22643/19a08397-ab57-46f7-b983-e6a3bc005bc2/cee3a926-deeb-40c7-8cda-e34f3786308a) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:58:27.032553 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-6a3e6027-525c-475e-800b-2d6515cc512f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.064575 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-6a3e6027-525c-475e-800b-2d6515cc512f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.076419 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['311b993c-d963-4bbd-9dd2-91f64ff1d918'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:58:27.106454 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-6a3e6027-525c-475e-800b-2d6515cc512f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Network e593a34f-1f09-493d-aafd-a51b70c22643 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:58:27.112341 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-6a3e6027-525c-475e-800b-2d6515cc512f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:58:27.113778 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57222) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:27.115643 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-6a3e6027-525c-475e-800b-2d6515cc512f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:58:27.141657 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a3e6027-525c-475e-800b-2d6515cc512f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Pushing event updated for resources: {'Port': ['ID=cee3a926-deeb-40c7-8cda-e34f3786308a,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:27.170383 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-6a3e6027-525c-475e-800b-2d6515cc512f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:27.171001 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-6a3e6027-525c-475e-800b-2d6515cc512f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.189428 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-6a3e6027-525c-475e-800b-2d6515cc512f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5732543 Nov 21 13:58:27.205846 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Request body: {'port': {'device_id': '23e6a833-20e6-4882-89ae-bd33ce5e4b48', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:58:27.261595 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.381203 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Deleting port 8e8bea1e-c800-4023-ae18-82bbf43edf91 {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:27.381549 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.454345 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.454790 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.470251 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling delete_port for 8e8bea1e-c800-4023-ae18-82bbf43edf91 owned by network:floatingip {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:27.514115 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cee3a926-deeb-40c7-8cda-e34f3786308a {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:58:27.522026 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.533557 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Transition to ACTIVE for port object cee3a926-deeb-40c7-8cda-e34f3786308a will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:58:27.537398 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.603646 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Pushing event updated for resources: {'Port': ['ID=cee3a926-deeb-40c7-8cda-e34f3786308a,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:27.642460 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.655545 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Attempting to bind port cee3a926-deeb-40c7-8cda-e34f3786308a on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:58:27.656058 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Attempting to bind port cee3a926-deeb-40c7-8cda-e34f3786308a by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:58:27.656943 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Attempting to bind port cee3a926-deeb-40c7-8cda-e34f3786308a on network e593a34f-1f09-493d-aafd-a51b70c22643 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:58:27.661083 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Port cee3a926-deeb-40c7-8cda-e34f3786308a on network e593a34f-1f09-493d-aafd-a51b70c22643 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:58:27.661401 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Attempting to bind port cee3a926-deeb-40c7-8cda-e34f3786308a on network e593a34f-1f09-493d-aafd-a51b70c22643 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:58:27.666172 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 58, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:58:27.666422 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Checking segment: {'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:58:27.666804 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Bound using segment: {'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:58:27.667225 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Bound port: cee3a926-deeb-40c7-8cda-e34f3786308a, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:58:27.667568 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.668903 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Pushing event deleted for resources: {'Port': ['ID=8e8bea1e-c800-4023-ae18-82bbf43edf91,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:27.691636 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:27.692012 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:27.692359 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:27.692703 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:27.693038 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:27.693370 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:27.693697 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:27.694027 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:27.694355 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:27.694685 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:27.695011 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:27.695335 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:58:27.731641 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] For port cee3a926-deeb-40c7-8cda-e34f3786308a, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:58:27.736135 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for floatingip, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.736333 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] For port cee3a926-deeb-40c7-8cda-e34f3786308a, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cee3a926-deeb-40c7-8cda-e34f3786308a,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:58:27.736532 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.l3_db [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Floating IP 22fcc665-3948-4cad-a8d4-ec9d56c3a5b1 disassociated (deleted). External IP: 172.27.1.39, port: 5907d47d-9ae0-44a4-adf8-9e5e784f851a. Nov 21 13:58:27.740588 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.771987 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:27.772796 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:27.774180 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] 10.222.0.50 "PUT /v2.0/ports/cee3a926-deeb-40c7-8cda-e34f3786308a HTTP/1.1" status: 200 len: 1094 time: 0.5727935 Nov 21 13:58:27.779169 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '23e6a833-20e6-4882-89ae-bd33ce5e4b48', 'tag': 'cee3a926-deeb-40c7-8cda-e34f3786308a'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:58:27.782005 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-953059bd-78ac-49de-9972-199a9f73a167" -d '{"events": [{"name": "network-changed", "server_uuid": "23e6a833-20e6-4882-89ae-bd33ce5e4b48", "tag": "cee3a926-deeb-40c7-8cda-e34f3786308a"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:58:27.809529 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbe427fb-58df-44a8-a2ee-955fb17db46d service neutron] Pushing event updated for resources: {'Port': ['ID=cee3a926-deeb-40c7-8cda-e34f3786308a,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:27.864030 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:58:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ccb6b808-88f6-4acb-8449-48d85a839992 x-openstack-request-id: req-ccb6b808-88f6-4acb-8449-48d85a839992 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:58:27.864394 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "23e6a833-20e6-4882-89ae-bd33ce5e4b48", "tag": "cee3a926-deeb-40c7-8cda-e34f3786308a", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:58:27.864707 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-ccb6b808-88f6-4acb-8449-48d85a839992 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:58:27.865086 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '23e6a833-20e6-4882-89ae-bd33ce5e4b48', 'tag': 'cee3a926-deeb-40c7-8cda-e34f3786308a', 'status': 'completed', 'code': 200} Nov 21 13:58:27.874421 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-a96b0ac3-1b70-473f-be07-62d6fd37352e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:27.876576 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-a96b0ac3-1b70-473f-be07-62d6fd37352e service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=48fbf7b5fd2347789241c7658fd6bb83&device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 1097 time: 0.0555673 Nov 21 13:58:27.924453 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-e81ba2b9-984d-4e6d-944f-1f5330bd8682 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cee3a926-deeb-40c7-8cda-e34f3786308a HTTP/1.1" status: 200 len: 217 time: 0.0381131 Nov 21 13:58:27.975482 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-efa3696b-2fa1-4bf5-a1d2-ca9f05e31380 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:27.976952 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-efa3696b-2fa1-4bf5-a1d2-ca9f05e31380 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=19a08397-ab57-46f7-b983-e6a3bc005bc2 HTTP/1.1" status: 200 len: 855 time: 0.0439091 Nov 21 13:58:27.978027 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac6716f5-8606-4d1e-9260-9668c6162b2a req-a2da5c12-6c17-4a27-8548-4399a48166ac tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:27.979498 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ac6716f5-8606-4d1e-9260-9668c6162b2a req-a2da5c12-6c17-4a27-8548-4399a48166ac tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 944 time: 0.0954008 Nov 21 13:58:27.997792 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Router bec884cd-90a7-4717-a897-0e3e2c2c310b has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:58:28.012819 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-4b406514-7d22-41aa-a211-4f07802d81ed service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=e593a34f-1f09-493d-aafd-a51b70c22643&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0250607 Nov 21 13:58:28.083755 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ac6716f5-8606-4d1e-9260-9668c6162b2a req-2a523b64-870e-4d57-b6b8-be24b19c1ee0 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0959580 Nov 21 13:58:28.107584 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-42c42943-f295-40eb-a404-34bc22c05e7d service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868785 Nov 21 13:58:28.139044 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:58:28.144013 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:28.150215 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a91e0456-6ae1-41a4-8b77-6b344dbae46a None None] Sync routers for ids ['bec884cd-90a7-4717-a897-0e3e2c2c310b'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:58:28.160338 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a91e0456-6ae1-41a4-8b77-6b344dbae46a None None] Routers {'bec884cd-90a7-4717-a897-0e3e2c2c310b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:28.161072 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-a91e0456-6ae1-41a4-8b77-6b344dbae46a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:58:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['bec884cd-90a7-4717-a897-0e3e2c2c310b'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:28.176445 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-11244ca3-efe9-4ca0-9730-7c120c34b1ed tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "DELETE /v2.0/floatingips/22fcc665-3948-4cad-a8d4-ec9d56c3a5b1 HTTP/1.1" status: 204 len: 168 time: 1.0597727 Nov 21 13:58:28.176445 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a'}] {{(pid=109040) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:58:28.176895 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a0fb9e652e748194bc1d59d499050652e1260aa6f54aa3e041aed7364c74523c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1486a9cf-0365-45c1-824a-bad3a672f1fd" -d '{"events": [{"name": "network-changed", "server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]}' {{(pid=109040) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:58:28.202916 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d4c4fec5-1ee6-4a6f-9517-917b51e73813 req-94bab6df-e35d-4019-bd17-39665d7357be service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871725 Nov 21 13:58:28.293158 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-a91e0456-6ae1-41a4-8b77-6b344dbae46a None None] Set router bec884cd-90a7-4717-a897-0e3e2c2c310b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:28.308636 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:58:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-37e2f9c3-8bc2-49ef-8885-7138b36a624b x-openstack-request-id: req-37e2f9c3-8bc2-49ef-8885-7138b36a624b {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:58:28.309160 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a", "status": "completed", "code": 200}]} {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:58:28.309586 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-37e2f9c3-8bc2-49ef-8885-7138b36a624b {{(pid=109040) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:58:28.310166 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'status': 'completed', 'code': 200} Nov 21 13:58:28.357730 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-953059bd-78ac-49de-9972-199a9f73a167 req-4931825f-7fd2-4710-bafd-b4e4eac37652 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:28.359078 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-953059bd-78ac-49de-9972-199a9f73a167 req-4931825f-7fd2-4710-bafd-b4e4eac37652 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=48fbf7b5fd2347789241c7658fd6bb83&device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 1097 time: 0.0832732 Nov 21 13:58:28.425896 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6525767-e482-40a9-a6ae-e86dc782cdbf req-8624fb20-9450-4e41-ad90-0e943dee998e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:28.428223 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a6525767-e482-40a9-a6ae-e86dc782cdbf req-8624fb20-9450-4e41-ad90-0e943dee998e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0489340 Nov 21 13:58:28.444096 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-5741b796-bb6a-4123-ab43-5535ce06ebb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:28.445568 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-5741b796-bb6a-4123-ab43-5535ce06ebb0 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=3f91d0ec3fb5421aa1fb95a0cb0d040d&device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 1099 time: 0.1013265 Nov 21 13:58:28.481237 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-a6525767-e482-40a9-a6ae-e86dc782cdbf req-481aa07d-fc71-49fc-afb7-aa6042d1d66e tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471308 Nov 21 13:58:28.514808 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-a91e0456-6ae1-41a4-8b77-6b344dbae46a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98'}], 'enable_snat': True}, 'gw_port_id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:53:14Z', 'revision_number': 4, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port': {'id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:45:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:12Z', 'updated_at': '2021-11-21T13:53:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '8e41a24c-4ee3-43e7-88e0-f250d096d06f', 'name': '', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'mac_address': 'fa:16:3e:d0:dd:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_interface', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:14Z', 'updated_at': '2021-11-21T13:53:21Z', 'revision_number': 5, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'subnets': [{'id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:28.515213 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-953059bd-78ac-49de-9972-199a9f73a167 req-9d5e1d36-0fa1-41b4-b3a7-3544b2a220e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:28.517283 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-953059bd-78ac-49de-9972-199a9f73a167 req-9d5e1d36-0fa1-41b4-b3a7-3544b2a220e3 service neutron] 10.222.0.50 "GET /v2.0/networks?id=e593a34f-1f09-493d-aafd-a51b70c22643 HTTP/1.1" status: 200 len: 916 time: 0.1438763 Nov 21 13:58:28.540907 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a91e0456-6ae1-41a4-8b77-6b344dbae46a None None] Checking router: bec884cd-90a7-4717-a897-0e3e2c2c310b for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:58:28.549570 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a91e0456-6ae1-41a4-8b77-6b344dbae46a None None] Routers {'bec884cd-90a7-4717-a897-0e3e2c2c310b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:28.550165 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-a91e0456-6ae1-41a4-8b77-6b344dbae46a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:58:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['bec884cd-90a7-4717-a897-0e3e2c2c310b'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:28.563793 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-953059bd-78ac-49de-9972-199a9f73a167 req-15697768-1baa-4c4c-8a0f-fa8ffa376cff service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cee3a926-deeb-40c7-8cda-e34f3786308a HTTP/1.1" status: 200 len: 217 time: 0.0374024 Nov 21 13:58:28.620848 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-5d883218-8751-41a4-8411-124dcd4380eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:28.622292 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-5d883218-8751-41a4-8411-124dcd4380eb service neutron] 10.222.0.50 "GET /v2.0/networks?id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f HTTP/1.1" status: 200 len: 910 time: 0.1640553 Nov 21 13:58:28.632125 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-953059bd-78ac-49de-9972-199a9f73a167 req-18310812-6afb-4694-80f1-6fe87605d967 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:28.633452 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-953059bd-78ac-49de-9972-199a9f73a167 req-18310812-6afb-4694-80f1-6fe87605d967 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=19a08397-ab57-46f7-b983-e6a3bc005bc2 HTTP/1.1" status: 200 len: 855 time: 0.0615232 Nov 21 13:58:28.654702 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-a91e0456-6ae1-41a4-8b77-6b344dbae46a None None] Set router bec884cd-90a7-4717-a897-0e3e2c2c310b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:28.673894 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-68519505-28e6-41e5-a34b-026133a1b30d service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a HTTP/1.1" status: 200 len: 217 time: 0.0434818 Nov 21 13:58:28.693246 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-953059bd-78ac-49de-9972-199a9f73a167 req-ec58e5e0-d026-4f21-8238-4d35879d38bd service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=e593a34f-1f09-493d-aafd-a51b70c22643&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0273623 Nov 21 13:58:28.780975 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-be73c63c-ba61-4e77-b0cb-042ff40316cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:28.782970 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-be73c63c-ba61-4e77-b0cb-042ff40316cf service neutron] 10.222.0.50 "GET /v2.0/subnets?id=10eb4393-a8dc-4fd9-855e-e410045be9e3 HTTP/1.1" status: 200 len: 848 time: 0.0923140 Nov 21 13:58:28.842165 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-953059bd-78ac-49de-9972-199a9f73a167 req-04280472-4891-493b-86f2-53b861a31f54 service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1401551 Nov 21 13:58:28.848522 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-f29b6110-e21d-48b7-ab89-11ba71937996 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:28.849884 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-f29b6110-e21d-48b7-ab89-11ba71937996 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=0f3bd10b-114c-4dbf-afd6-006b9d81d12f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0592790 Nov 21 13:58:28.851172 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-a91e0456-6ae1-41a4-8b77-6b344dbae46a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98'}], 'enable_snat': True}, 'gw_port_id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:53:14Z', 'revision_number': 4, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port': {'id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:45:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:12Z', 'updated_at': '2021-11-21T13:53:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '8e41a24c-4ee3-43e7-88e0-f250d096d06f', 'name': '', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'mac_address': 'fa:16:3e:d0:dd:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_interface', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:14Z', 'updated_at': '2021-11-21T13:53:21Z', 'revision_number': 5, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'subnets': [{'id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:28.881643 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a91e0456-6ae1-41a4-8b77-6b344dbae46a None None] The sync data for ids ['bec884cd-90a7-4717-a897-0e3e2c2c310b'] in dv-cinder-768458-12-iscsi is: [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98'}], 'enable_snat': True}, 'gw_port_id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:53:14Z', 'revision_number': 4, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port': {'id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:45:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:12Z', 'updated_at': '2021-11-21T13:53:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '8e41a24c-4ee3-43e7-88e0-f250d096d06f', 'name': '', 'network_id': '0f3bd10b-114c-4dbf-afd6-006b9d81d12f', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'mac_address': 'fa:16:3e:d0:dd:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_interface', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:14Z', 'updated_at': '2021-11-21T13:53:21Z', 'revision_number': 5, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'subnets': [{'id': '10eb4393-a8dc-4fd9-855e-e410045be9e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:58:29.002005 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-953059bd-78ac-49de-9972-199a9f73a167 req-a24e54db-ed18-41c9-b431-b5c14610adbf service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1511989 Nov 21 13:58:29.005481 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-8c91fd04-b078-4e54-8984-f624d9e7854a service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1472187 Nov 21 13:58:29.105230 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f333843c-3da1-402b-adab-32b5d88697f2 None None] New status for floating IP 22fcc665-3948-4cad-a8d4-ec9d56c3a5b1: DOWN {{(pid=109042) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 13:58:29.118317 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1486a9cf-0365-45c1-824a-bad3a672f1fd req-9ae6b194-b084-45c6-8902-1ba281729f4d service neutron] 10.222.0.50 "GET /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0992379 Nov 21 13:58:29.205659 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514a56ee-d4c9-4713-8f23-ff2853f80fcf req-77437b00-9661-492a-9ea7-237950e5aef9 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:29.207177 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-514a56ee-d4c9-4713-8f23-ff2853f80fcf req-77437b00-9661-492a-9ea7-237950e5aef9 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 944 time: 0.0515518 Nov 21 13:58:29.253550 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-514a56ee-d4c9-4713-8f23-ff2853f80fcf req-9bf57744-69df-49f7-b931-b6d44b5dc467 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404999 Nov 21 13:58:29.596328 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7de3f60d-95e4-40df-a805-d0bdd8f2756d req-5ac69205-86d5-49f7-8865-ecc239e18807 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:29.597946 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7de3f60d-95e4-40df-a805-d0bdd8f2756d req-5ac69205-86d5-49f7-8865-ecc239e18807 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0478668 Nov 21 13:58:29.645028 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7de3f60d-95e4-40df-a805-d0bdd8f2756d req-afa03dcf-eb0c-41f8-8d9d-fe5e5af6e9ff tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415719 Nov 21 13:58:30.174038 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-815c7b62-18a6-4038-ac0c-303b5a3b438c req-2b78e829-b525-4017-80e0-2d82835efa3a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:30.175627 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-815c7b62-18a6-4038-ac0c-303b5a3b438c req-2b78e829-b525-4017-80e0-2d82835efa3a tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.50 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0505776 Nov 21 13:58:30.217317 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-28eaee39-2f54-4a89-b710-020de9b2ebcc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:30.278774 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-815c7b62-18a6-4038-ac0c-303b5a3b438c req-c003d733-2a26-4e08-b410-b67e849bb319 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Deleting port 5907d47d-9ae0-44a4-adf8-9e5e784f851a {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:30.279251 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-815c7b62-18a6-4038-ac0c-303b5a3b438c req-c003d733-2a26-4e08-b410-b67e849bb319 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:30.478856 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771b85df-5de5-4a97-afbd-efc0393a1331 req-2b82281c-3df5-45d9-ad52-d78bcf6c8f1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:30.480447 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-771b85df-5de5-4a97-afbd-efc0393a1331 req-2b82281c-3df5-45d9-ad52-d78bcf6c8f1a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 946 time: 0.0543711 Nov 21 13:58:30.529877 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-771b85df-5de5-4a97-afbd-efc0393a1331 req-16378c20-e8b0-4b50-91dc-5d3c2b2a3e06 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425394 Nov 21 13:58:30.612746 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:58:30.676971 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-815c7b62-18a6-4038-ac0c-303b5a3b438c req-c003d733-2a26-4e08-b410-b67e849bb319 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] For port 5907d47d-9ae0-44a4-adf8-9e5e784f851a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=5907d47d-9ae0-44a4-adf8-9e5e784f851a,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:30.677330 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-815c7b62-18a6-4038-ac0c-303b5a3b438c req-c003d733-2a26-4e08-b410-b67e849bb319 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:30.686595 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81cc5d4-9ec5-468e-b166-4339638c888e req-46a1ec61-b747-4770-b643-4df2f0ac360f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:30.688147 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c81cc5d4-9ec5-468e-b166-4339638c888e req-46a1ec61-b747-4770-b643-4df2f0ac360f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 944 time: 0.3572333 Nov 21 13:58:30.704062 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-815c7b62-18a6-4038-ac0c-303b5a3b438c req-c003d733-2a26-4e08-b410-b67e849bb319 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Calling delete_port for 5907d47d-9ae0-44a4-adf8-9e5e784f851a owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:30.759403 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8802979-5bd5-4ce3-8f14-bbfe53feef10 req-0657ba74-d799-4137-b910-a7999c68194c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:30.761063 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c8802979-5bd5-4ce3-8f14-bbfe53feef10 req-0657ba74-d799-4137-b910-a7999c68194c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/ports?device_id=2707c966-28e3-43ba-9241-d5629ba92b06 HTTP/1.1" status: 200 len: 946 time: 0.0494804 Nov 21 13:58:30.781978 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c81cc5d4-9ec5-468e-b166-4339638c888e req-3ce1ffcf-1e24-4bcf-b02c-27cb6c86aea6 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0867064 Nov 21 13:58:30.820503 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c8802979-5bd5-4ce3-8f14-bbfe53feef10 req-9ae6b2f8-4950-4f77-b3ba-ad11f214bd5f tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "GET /v2.0/security-groups?id=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515223 Nov 21 13:58:30.868542 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-815c7b62-18a6-4038-ac0c-303b5a3b438c req-c003d733-2a26-4e08-b410-b67e849bb319 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:30.894587 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c003d733-2a26-4e08-b410-b67e849bb319 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Pushing event deleted for resources: {'Port': ['ID=5907d47d-9ae0-44a4-adf8-9e5e784f851a,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:30.940578 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-815c7b62-18a6-4038-ac0c-303b5a3b438c req-c003d733-2a26-4e08-b410-b67e849bb319 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] No DVR routers for this DVR port 5907d47d-9ae0-44a4-adf8-9e5e784f851a on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:58:30.942982 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-815c7b62-18a6-4038-ac0c-303b5a3b438c req-c003d733-2a26-4e08-b410-b67e849bb319 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:30.946317 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-815c7b62-18a6-4038-ac0c-303b5a3b438c req-c003d733-2a26-4e08-b410-b67e849bb319 tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.50 "DELETE /v2.0/ports/5907d47d-9ae0-44a4-adf8-9e5e784f851a HTTP/1.1" status: 204 len: 173 time: 0.7627161 Nov 21 13:58:30.946748 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'name': 'network-vif-deleted', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:58:30.949008 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-96b8f078-564a-477d-9d29-5a72c49f85ad" -d '{"events": [{"server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "name": "network-vif-deleted", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:58:30.984311 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:58:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd3c0445-bb04-4c0d-bc8b-274c865d597b x-openstack-request-id: req-cd3c0445-bb04-4c0d-bc8b-274c865d597b {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:58:30.984605 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2707c966-28e3-43ba-9241-d5629ba92b06", "name": "network-vif-deleted", "tag": "5907d47d-9ae0-44a4-adf8-9e5e784f851a", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:58:30.984855 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-cd3c0445-bb04-4c0d-bc8b-274c865d597b {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:58:30.985249 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2707c966-28e3-43ba-9241-d5629ba92b06', 'name': 'network-vif-deleted', 'tag': '5907d47d-9ae0-44a4-adf8-9e5e784f851a', 'status': 'completed', 'code': 200} Nov 21 13:58:31.208973 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device cee3a926-deeb-40c7-8cda-e34f3786308a details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:58:31.317214 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port cee3a926-deeb-40c7-8cda-e34f3786308a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cee3a926-deeb-40c7-8cda-e34f3786308a,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:31.332871 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': 'cee3a926-deeb-40c7-8cda-e34f3786308a', 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643', 'port_id': 'cee3a926-deeb-40c7-8cda-e34f3786308a', 'mac_address': 'fa:16:3e:2e:30:ea', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 511, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '19a08397-ab57-46f7-b983-e6a3bc005bc2', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:58:31.372220 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:31.386505 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cee3a926-deeb-40c7-8cda-e34f3786308a {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:58:31.414397 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port cee3a926-deeb-40c7-8cda-e34f3786308a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cee3a926-deeb-40c7-8cda-e34f3786308a,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:31.418529 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:31.478069 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=cee3a926-deeb-40c7-8cda-e34f3786308a,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:31.647909 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b074948-5542-4029-a04a-7a7915bc6d9b req-e9a677ed-352e-4f66-a052-1d8d42869dc9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:31.649364 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3b074948-5542-4029-a04a-7a7915bc6d9b req-e9a677ed-352e-4f66-a052-1d8d42869dc9 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 946 time: 0.0484669 Nov 21 13:58:31.701086 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['cee3a926-deeb-40c7-8cda-e34f3786308a'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:58:31.701268 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3b074948-5542-4029-a04a-7a7915bc6d9b req-b91b245f-38a9-44a2-86df-caa3ca9e1823 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456088 Nov 21 13:58:31.870272 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57266) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:31.902067 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdcc46a9-795e-4bf0-b845-420d8145aa32 req-9cca617c-d35d-4a69-bafa-12bbc25dcaaa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:31.903664 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bdcc46a9-795e-4bf0-b845-420d8145aa32 req-9cca617c-d35d-4a69-bafa-12bbc25dcaaa tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 945 time: 0.0525155 Nov 21 13:58:31.927470 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e58e8a61-ced1-4674-825b-cd916d73ac1c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:31.950406 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-bdcc46a9-795e-4bf0-b845-420d8145aa32 req-497a8421-e0c5-4ea3-b597-83d01cf07e9d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401468 Nov 21 13:58:31.952072 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e58e8a61-ced1-4674-825b-cd916d73ac1c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:32.009034 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e58e8a61-ced1-4674-825b-cd916d73ac1c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:32.011466 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e58e8a61-ced1-4674-825b-cd916d73ac1c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:32.012656 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-e58e8a61-ced1-4674-825b-cd916d73ac1c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] 10.222.0.11 "DELETE /v2.0/security-groups/fb84cf77-f8c9-48da-99ba-8e7bf40a09ed HTTP/1.1" status: 204 len: 168 time: 0.1413922 Nov 21 13:58:32.022681 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e58e8a61-ced1-4674-825b-cd916d73ac1c tempest-TestShelveInstance-91795780 tempest-TestShelveInstance-91795780-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb84cf77-f8c9-48da-99ba-8e7bf40a09ed,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:32.054436 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57270) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:32.082667 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-005b061a-6773-4422-aa98-693d2cee11ff req-87cb8cd9-fc5b-4e38-884c-817efe956249 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:32.084126 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-005b061a-6773-4422-aa98-693d2cee11ff req-87cb8cd9-fc5b-4e38-884c-817efe956249 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.50 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 946 time: 0.0543807 Nov 21 13:58:32.263389 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Deleting port 73851145-2483-4c28-bf3b-f049e97c28cc {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:32.263645 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:32.426126 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] For port 73851145-2483-4c28-bf3b-f049e97c28cc, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=73851145-2483-4c28-bf3b-f049e97c28cc,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:32.426490 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:32.569918 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0766b995-4983-47d9-9a96-57a2952031bb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:32.659110 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:32.659465 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:32.659782 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.l3_db [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Floating IP df220ba1-ef93-4c8b-a2f7-65a74fda1ae6 disassociated. External IP: 172.27.1.178, port: 73851145-2483-4c28-bf3b-f049e97c28cc. Nov 21 13:58:32.660151 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling delete_port for 73851145-2483-4c28-bf3b-f049e97c28cc owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:32.773106 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-94937621-577d-4fad-8e32-0e3a5fb35371 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-473237'] for router_interface, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:32.934044 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:32.945941 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-042e97fd-c4d5-4258-92a2-ac7900707f7e req-4cac80e4-9e9f-463d-995b-6a02e038bb39 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:32.947378 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-042e97fd-c4d5-4258-92a2-ac7900707f7e req-4cac80e4-9e9f-463d-995b-6a02e038bb39 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/ports?device_id=e70a1a57-c34e-418a-b973-e938389a3fa2 HTTP/1.1" status: 200 len: 868 time: 0.1415460 Nov 21 13:58:33.008640 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event deleted for resources: {'Port': ['ID=73851145-2483-4c28-bf3b-f049e97c28cc,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:33.070428 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efffcc34-f7a4-439c-be88-afa4bf16bcbd req-7b9cd1e7-9a63-4c33-8fa1-5be837495d69 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:33.071966 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-efffcc34-f7a4-439c-be88-afa4bf16bcbd req-7b9cd1e7-9a63-4c33-8fa1-5be837495d69 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 945 time: 0.0543082 Nov 21 13:58:33.119517 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-042e97fd-c4d5-4258-92a2-ac7900707f7e req-b0664d67-1aef-42d8-ab0b-6703569a3ab1 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups?id=8c3a1f04-58b3-451a-8948-b2f8f099915c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1439400 Nov 21 13:58:33.119770 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-efffcc34-f7a4-439c-be88-afa4bf16bcbd req-85d4aa36-2114-4bd2-9b3d-5864434c9cc8 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413980 Nov 21 13:58:33.206088 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Router 0f049428-3827-4a0f-9254-57ee6dba40c0 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:58:33.222137 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device cee3a926-deeb-40c7-8cda-e34f3786308a up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:58:33.275789 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port cee3a926-deeb-40c7-8cda-e34f3786308a completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:58:33.279731 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port cee3a926-deeb-40c7-8cda-e34f3786308a triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:58:33.280137 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:33.337673 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-94937621-577d-4fad-8e32-0e3a5fb35371 admin admin] Deleting port 8e41a24c-4ee3-43e7-88e0-f250d096d06f {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:33.337928 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-94937621-577d-4fad-8e32-0e3a5fb35371 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:33.356534 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:33.380378 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '23e6a833-20e6-4882-89ae-bd33ce5e4b48', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cee3a926-deeb-40c7-8cda-e34f3786308a'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:58:33.382805 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-79c63e0a-88a7-4644-b77d-75461c596aa0" -d '{"events": [{"server_uuid": "23e6a833-20e6-4882-89ae-bd33ce5e4b48", "name": "network-vif-plugged", "status": "completed", "tag": "cee3a926-deeb-40c7-8cda-e34f3786308a"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:58:33.386204 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:58:33.396858 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port cee3a926-deeb-40c7-8cda-e34f3786308a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cee3a926-deeb-40c7-8cda-e34f3786308a,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:33.401174 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:33.402201 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 5907d47d-9ae0-44a4-adf8-9e5e784f851a no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:33.412768 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85808c61-273b-4647-a1d1-c72ae8ddf2be None None] Sync routers for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:58:33.428239 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85808c61-273b-4647-a1d1-c72ae8ddf2be None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:33.434126 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-85808c61-273b-4647-a1d1-c72ae8ddf2be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:58:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:33.439179 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] No DVR routers for this DVR port 73851145-2483-4c28-bf3b-f049e97c28cc on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:58:33.446972 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:33.449213 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: 5907d47d-9ae0-44a4-adf8-9e5e784f851a {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:33.449642 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 5907d47d-9ae0-44a4-adf8-9e5e784f851a not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:33.450368 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-005b061a-6773-4422-aa98-693d2cee11ff req-fc6e5448-325b-404e-b1cd-f52327dcab0b tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.50 "DELETE /v2.0/ports/73851145-2483-4c28-bf3b-f049e97c28cc HTTP/1.1" status: 204 len: 173 time: 1.3592079 Nov 21 13:58:33.450817 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'name': 'network-vif-deleted', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:58:33.453138 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:58:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-defeaeb7-4f44-4c00-86de-120605b7c345 x-openstack-request-id: req-defeaeb7-4f44-4c00-86de-120605b7c345 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:58:33.453289 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3d848ff-3c6a-4077-adf8-4faebd28abf3" -d '{"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-deleted", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:58:33.453646 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "23e6a833-20e6-4882-89ae-bd33ce5e4b48", "name": "network-vif-plugged", "status": "completed", "tag": "cee3a926-deeb-40c7-8cda-e34f3786308a", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:58:33.454002 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-defeaeb7-4f44-4c00-86de-120605b7c345 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:58:33.454475 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '23e6a833-20e6-4882-89ae-bd33ce5e4b48', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cee3a926-deeb-40c7-8cda-e34f3786308a', 'code': 200} Nov 21 13:58:33.481029 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [None req-94937621-577d-4fad-8e32-0e3a5fb35371 admin admin] For port 8e41a24c-4ee3-43e7-88e0-f250d096d06f, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=8e41a24c-4ee3-43e7-88e0-f250d096d06f,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:33.481412 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-94937621-577d-4fad-8e32-0e3a5fb35371 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:33.505426 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-94937621-577d-4fad-8e32-0e3a5fb35371 admin admin] Calling delete_port for 8e41a24c-4ee3-43e7-88e0-f250d096d06f owned by network:router_interface {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:33.522955 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=cee3a926-deeb-40c7-8cda-e34f3786308a,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:33.571836 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:58:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c0400ce7-a6cb-4607-b5a5-e3c7676df531 x-openstack-request-id: req-c0400ce7-a6cb-4607-b5a5-e3c7676df531 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:58:33.572329 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e70a1a57-c34e-418a-b973-e938389a3fa2", "name": "network-vif-deleted", "tag": "73851145-2483-4c28-bf3b-f049e97c28cc", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:58:33.572761 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-c0400ce7-a6cb-4607-b5a5-e3c7676df531 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:58:33.573313 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e70a1a57-c34e-418a-b973-e938389a3fa2', 'name': 'network-vif-deleted', 'tag': '73851145-2483-4c28-bf3b-f049e97c28cc', 'status': 'completed', 'code': 200} Nov 21 13:58:33.628004 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-85808c61-273b-4647-a1d1-c72ae8ddf2be None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:33.753026 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d58821bc-51ba-458d-83dc-352608fd1119 req-fd0e9a2c-9228-4d44-8b5b-02c268012eb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:33.754485 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d58821bc-51ba-458d-83dc-352608fd1119 req-fd0e9a2c-9228-4d44-8b5b-02c268012eb2 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 1099 time: 0.0813751 Nov 21 13:58:33.777230 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-94937621-577d-4fad-8e32-0e3a5fb35371 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:33.806076 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94937621-577d-4fad-8e32-0e3a5fb35371 admin admin] Pushing event deleted for resources: {'Port': ['ID=8e41a24c-4ee3-43e7-88e0-f250d096d06f,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:33.844170 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-85808c61-273b-4647-a1d1-c72ae8ddf2be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:59Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:33.863750 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d58821bc-51ba-458d-83dc-352608fd1119 req-5660f5ca-95d3-489e-9e4a-a6681ed2cb16 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0991449 Nov 21 13:58:33.876300 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85808c61-273b-4647-a1d1-c72ae8ddf2be None None] Checking router: 0f049428-3827-4a0f-9254-57ee6dba40c0 for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:58:33.885577 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85808c61-273b-4647-a1d1-c72ae8ddf2be None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:33.886480 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-85808c61-273b-4647-a1d1-c72ae8ddf2be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:58:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:33.897989 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:33.991790 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-94937621-577d-4fad-8e32-0e3a5fb35371 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1684491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-473209'] for router_interface, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:34.003443 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-85808c61-273b-4647-a1d1-c72ae8ddf2be None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:34.222484 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57288) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:34.257010 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa80464-8356-4cbd-ab3e-695c75d54792 req-02dd56f0-3e61-4445-82dc-5302733c8e26 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:34.259126 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-aaa80464-8356-4cbd-ab3e-695c75d54792 req-02dd56f0-3e61-4445-82dc-5302733c8e26 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 946 time: 0.0595391 Nov 21 13:58:34.260991 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-94937621-577d-4fad-8e32-0e3a5fb35371 admin admin] Router bec884cd-90a7-4717-a897-0e3e2c2c310b has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:58:34.302011 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-85808c61-273b-4647-a1d1-c72ae8ddf2be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:59Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:34.314436 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-aaa80464-8356-4cbd-ab3e-695c75d54792 req-30282ee3-9eef-4cab-818a-d602c429e383 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490682 Nov 21 13:58:34.330572 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85808c61-273b-4647-a1d1-c72ae8ddf2be None None] The sync data for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi is: [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:51:50Z', 'revision_number': 4, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '352f29a9-b7fa-46f1-bcc4-584ce9176e66', 'name': '', 'network_id': '24c864ef-5c5a-4df8-8968-78a7fe30b188', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'mac_address': 'fa:16:3e:d4:4b:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:48Z', 'updated_at': '2021-11-21T13:51:59Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'subnets': [{'id': 'c4887ea6-9c0e-4a7b-bd51-d70b335ceb92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:58:34.342495 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-42375618-6367-4bc8-a289-3c8fe3bff78a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:34.405134 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-42375618-6367-4bc8-a289-3c8fe3bff78a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:34.427152 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-94937621-577d-4fad-8e32-0e3a5fb35371 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:58:34.433316 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-94937621-577d-4fad-8e32-0e3a5fb35371 admin admin] 10.222.0.11 "PUT /v2.0/routers/bec884cd-90a7-4717-a897-0e3e2c2c310b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3751686 Nov 21 13:58:34.436060 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57290) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:34.438776 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d37a6ab-1c58-40f6-a50c-d4dba2f527fa None None] Sync routers for ids ['bec884cd-90a7-4717-a897-0e3e2c2c310b'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:58:34.449321 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d37a6ab-1c58-40f6-a50c-d4dba2f527fa None None] Routers {'bec884cd-90a7-4717-a897-0e3e2c2c310b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:34.450149 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-4d37a6ab-1c58-40f6-a50c-d4dba2f527fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:58:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['bec884cd-90a7-4717-a897-0e3e2c2c310b'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:34.467271 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-42375618-6367-4bc8-a289-3c8fe3bff78a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:34.470767 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-42375618-6367-4bc8-a289-3c8fe3bff78a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:34.474704 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-42375618-6367-4bc8-a289-3c8fe3bff78a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "DELETE /v2.0/security-groups/8c3a1f04-58b3-451a-8948-b2f8f099915c HTTP/1.1" status: 204 len: 168 time: 0.2512569 Nov 21 13:58:34.475293 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57292) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:34.496821 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42375618-6367-4bc8-a289-3c8fe3bff78a tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c3a1f04-58b3-451a-8948-b2f8f099915c,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:34.499128 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.api.v2.resource [None req-7a528fbc-b1ad-4266-84d3-2cbc4d047236 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] show failed (client error): The resource could not be found. Nov 21 13:58:34.503115 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-7a528fbc-b1ad-4266-84d3-2cbc4d047236 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "GET /v2.0/security-groups/8c3a1f04-58b3-451a-8948-b2f8f099915c HTTP/1.1" status: 404 len: 347 time: 0.0241241 Nov 21 13:58:34.504103 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57294) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:34.560885 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Publish callbacks [] for router, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:34.599600 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-4d37a6ab-1c58-40f6-a50c-d4dba2f527fa None None] Set router bec884cd-90a7-4717-a897-0e3e2c2c310b gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:34.645065 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-9701f91e-a168-4d6f-9e61-a3c86de92844 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Deleting port a94eabff-a869-4427-92e5-18a7a87285f6 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:34.645560 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9701f91e-a168-4d6f-9e61-a3c86de92844 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:34.677089 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:34.685511 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f1e011d-afa3-4c25-99ab-462d3202e097 None None] New status for floating IP df220ba1-ef93-4c8b-a2f7-65a74fda1ae6: DOWN {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 13:58:34.739926 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Deleting port 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92 {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:34.740281 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:34.809619 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-4d37a6ab-1c58-40f6-a50c-d4dba2f527fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98'}], 'enable_snat': True}, 'gw_port_id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:58:33Z', 'revision_number': 5, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port': {'id': '7a2f37a4-fa1b-4b98-a9da-cdcaff390f92', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:e1:45:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 334, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.98', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:12Z', 'updated_at': '2021-11-21T13:53:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:34.844918 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] For port 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=7a2f37a4-fa1b-4b98-a9da-cdcaff390f92,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:34.845434 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:34.848282 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d37a6ab-1c58-40f6-a50c-d4dba2f527fa None None] Checking router: bec884cd-90a7-4717-a897-0e3e2c2c310b for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:58:34.857430 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d37a6ab-1c58-40f6-a50c-d4dba2f527fa None None] Routers {'bec884cd-90a7-4717-a897-0e3e2c2c310b'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:34.858051 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-4d37a6ab-1c58-40f6-a50c-d4dba2f527fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:58:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['bec884cd-90a7-4717-a897-0e3e2c2c310b'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:34.867293 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Calling delete_port for 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92 owned by network:router_gateway {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:34.946927 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-4d37a6ab-1c58-40f6-a50c-d4dba2f527fa None None] Set router bec884cd-90a7-4717-a897-0e3e2c2c310b gateway port host: None {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:34.999413 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-4d37a6ab-1c58-40f6-a50c-d4dba2f527fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:58:34Z', 'revision_number': 6, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port_host': None}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:35.030326 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d37a6ab-1c58-40f6-a50c-d4dba2f527fa None None] The sync data for ids ['bec884cd-90a7-4717-a897-0e3e2c2c310b'] in dv-cinder-768458-12-iscsi is: [{'id': 'bec884cd-90a7-4717-a897-0e3e2c2c310b', 'name': 'tempest-TestShelveInstance-1100723654-router', 'tenant_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:11Z', 'updated_at': '2021-11-21T13:58:34Z', 'revision_number': 6, 'project_id': '3f91d0ec3fb5421aa1fb95a0cb0d040d', 'gw_port_host': None}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:58:35.048257 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9701f91e-a168-4d6f-9e61-a3c86de92844 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.048851 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9701f91e-a168-4d6f-9e61-a3c86de92844 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.065272 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.076584 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-9701f91e-a168-4d6f-9e61-a3c86de92844 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Calling delete_port for a94eabff-a869-4427-92e5-18a7a87285f6 owned by network:floatingip {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:35.089867 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.095841 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Pushing event deleted for resources: {'Port': ['ID=7a2f37a4-fa1b-4b98-a9da-cdcaff390f92,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:35.161031 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-471003'] for router_gateway, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.217334 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9701f91e-a168-4d6f-9e61-a3c86de92844 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.221483 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 73851145-2483-4c28-bf3b-f049e97c28cc no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:35.241787 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: 73851145-2483-4c28-bf3b-f049e97c28cc {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:35.242245 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 73851145-2483-4c28-bf3b-f049e97c28cc not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:35.244602 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9701f91e-a168-4d6f-9e61-a3c86de92844 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Pushing event deleted for resources: {'Port': ['ID=a94eabff-a869-4427-92e5-18a7a87285f6,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:35.251722 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-470817', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-58426'] for router, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.253943 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.300514 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-470840'] for router, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.301191 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Fanout notify agent at l3_agent the message router_deleted on router bec884cd-90a7-4717-a897-0e3e2c2c310b {{(pid=109040) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 21 13:58:35.306123 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] Publish callbacks [] for router, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.306788 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9701f91e-a168-4d6f-9e61-a3c86de92844 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks [] for floatingip, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.307353 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-1bd48dcd-bc86-4a19-9da4-7feb39b35e9c admin admin] 10.222.0.11 "DELETE /v2.0/routers/bec884cd-90a7-4717-a897-0e3e2c2c310b HTTP/1.1" status: 204 len: 168 time: 0.8700979 Nov 21 13:58:35.309392 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9701f91e-a168-4d6f-9e61-a3c86de92844 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.309765 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57296) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:35.310509 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-9701f91e-a168-4d6f-9e61-a3c86de92844 tempest-AttachVolumeShelveTestJSON-494788509 tempest-AttachVolumeShelveTestJSON-494788509-project] 10.222.0.11 "DELETE /v2.0/floatingips/df220ba1-ef93-4c8b-a2f7-65a74fda1ae6 HTTP/1.1" status: 204 len: 168 time: 0.8055019 Nov 21 13:58:35.370405 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_v2 [None req-f8a3facc-ac7b-4621-a7e2-f0092d9cd707 admin admin] Deleting subnet 10eb4393-a8dc-4fd9-855e-e410045be9e3 {{(pid=109040) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 13:58:35.374427 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f8a3facc-ac7b-4621-a7e2-f0092d9cd707 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.421195 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f8a3facc-ac7b-4621-a7e2-f0092d9cd707 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-261998919'] for subnet, precommit_delete_associations {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.508921 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae207fe4-f2e8-4d0f-8e56-140b33999e18 req-5b48d2ba-253e-44e4-8843-e6582f83ab5d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:35.512826 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ae207fe4-f2e8-4d0f-8e56-140b33999e18 req-5b48d2ba-253e-44e4-8843-e6582f83ab5d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 946 time: 0.0846832 Nov 21 13:58:35.559342 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f8a3facc-ac7b-4621-a7e2-f0092d9cd707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.578681 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ae207fe4-f2e8-4d0f-8e56-140b33999e18 req-ebdc8f8b-0f68-4170-ba3f-c78ce3b12f2a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533288 Nov 21 13:58:35.615334 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f8a3facc-ac7b-4621-a7e2-f0092d9cd707 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2298272', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261670867'] for subnet, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.642323 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8a3facc-ac7b-4621-a7e2-f0092d9cd707 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=10eb4393-a8dc-4fd9-855e-e410045be9e3,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:35.646129 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-f8a3facc-ac7b-4621-a7e2-f0092d9cd707 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.649645 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-f8a3facc-ac7b-4621-a7e2-f0092d9cd707 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/10eb4393-a8dc-4fd9-855e-e410045be9e3 HTTP/1.1" status: 204 len: 168 time: 0.3388255 Nov 21 13:58:35.652284 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57308) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:35.655358 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a6690b3-2c88-4cba-ace0-7b2ca02ff6dd None None] Network 0f3bd10b-114c-4dbf-afd6-006b9d81d12f requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:58:35.748864 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.820192 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Deleting port b68fb0d4-2758-482a-8e42-7051d5917f69 {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:35.820538 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.856575 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.872064 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa65a0a3-e157-41ea-85cd-d055c3bd2728 None None] DHCP port deletion for 0f3bd10b-114c-4dbf-afd6-006b9d81d12f request from dv-cinder-768458-12-iscsi {{(pid=109042) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 21 13:58:35.896549 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] For port b68fb0d4-2758-482a-8e42-7051d5917f69, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=b68fb0d4-2758-482a-8e42-7051d5917f69,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:35.897021 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:35.911677 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Calling delete_port for b68fb0d4-2758-482a-8e42-7051d5917f69 owned by network:dhcp {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:35.929030 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-fa65a0a3-e157-41ea-85cd-d055c3bd2728 None None] Deleting port b68fb0d4-2758-482a-8e42-7051d5917f69 {{(pid=109042) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:35.929399 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fa65a0a3-e157-41ea-85cd-d055c3bd2728 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:36.149998 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-fa65a0a3-e157-41ea-85cd-d055c3bd2728 None None] For port b68fb0d4-2758-482a-8e42-7051d5917f69, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=b68fb0d4-2758-482a-8e42-7051d5917f69,segment=NetworkSegment(4106bdcf-85b4-49b9-9a69-c6db5fd40e84),segment_id=4106bdcf-85b4-49b9-9a69-c6db5fd40e84)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:36.151095 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fa65a0a3-e157-41ea-85cd-d055c3bd2728 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:36.167661 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-fa65a0a3-e157-41ea-85cd-d055c3bd2728 None None] Calling delete_port for b68fb0d4-2758-482a-8e42-7051d5917f69 owned by network:dhcp {{(pid=109042) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:36.253936 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fa65a0a3-e157-41ea-85cd-d055c3bd2728 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855'] for port, after_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:36.260943 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:36.279594 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa65a0a3-e157-41ea-85cd-d055c3bd2728 None None] Pushing event deleted for resources: {'Port': ['ID=b68fb0d4-2758-482a-8e42-7051d5917f69,revision_number=None']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:36.283780 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa65a0a3-e157-41ea-85cd-d055c3bd2728 None None] No DVR routers for this DVR port b68fb0d4-2758-482a-8e42-7051d5917f69 on host dv-cinder-768458-12-iscsi {{(pid=109042) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:58:36.293019 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Pushing event deleted for resources: {'Port': ['ID=b68fb0d4-2758-482a-8e42-7051d5917f69,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:36.294819 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] No DVR routers for this DVR port b68fb0d4-2758-482a-8e42-7051d5917f69 on host dv-cinder-768458-12-iscsi {{(pid=109040) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:58:36.369171 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:36.390259 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0f3bd10b-114c-4dbf-afd6-006b9d81d12f']}} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:36.400116 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4106bdcf-85b4-49b9-9a69-c6db5fd40e84') {'for_net_delete': True} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:36.400408 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4106bdcf-85b4-49b9-9a69-c6db5fd40e84') {} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:36.409832 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-261998924'] for segment, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:36.415163 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92 no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:36.426213 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:36.434522 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Releasing vlan 515 on physical network physnet1 to pool {{(pid=109040) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 13:58:36.434939 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2298122'] for segment, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: self.session.flush() Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: self.session.flush() Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: self.session.flush() Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: self.session.flush() Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: Traceback (most recent call last): Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: timer() Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: cb(*args, **kw) Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: return func(*args, **kwargs) Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: self._notify() Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: self.callback(batched_events) Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: event.method(event) Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: return f(self, *a, **k) Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._get(url).json() Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: return self.request(url, 'GET', **kwargs) Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 13:58:36.437722 dv-cinder-768458-12-iscsi neutron-server[109040]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 13:58:36.440313 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:36.440313 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 7a2f37a4-fa1b-4b98-a9da-cdcaff390f92 not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:36.440313 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device b68fb0d4-2758-482a-8e42-7051d5917f69 no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:36.458749 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: b68fb0d4-2758-482a-8e42-7051d5917f69 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:36.459095 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device b68fb0d4-2758-482a-8e42-7051d5917f69 not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:36.459505 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 8e41a24c-4ee3-43e7-88e0-f250d096d06f no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:36.478547 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: 8e41a24c-4ee3-43e7-88e0-f250d096d06f {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:36.479163 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 8e41a24c-4ee3-43e7-88e0-f250d096d06f not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:36.494022 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:36.499069 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:36.503129 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] 10.222.0.11 "DELETE /v2.0/networks/0f3bd10b-114c-4dbf-afd6-006b9d81d12f HTTP/1.1" status: 204 len: 168 time: 0.8498409 Nov 21 13:58:36.506293 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57320) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:36.515828 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f45f98f-f6f4-4de9-b0b6-4599fab86eb9 admin admin] Pushing event deleted for resources: {'Network': ['ID=0f3bd10b-114c-4dbf-afd6-006b9d81d12f,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:36.864674 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-2fd459ca-0687-452a-b056-76148efddfb5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-473237'] for router_interface, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:37.108158 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-2fd459ca-0687-452a-b056-76148efddfb5 admin admin] Deleting port a1e57f2b-371b-4596-a39c-06e2d41d6dac {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:37.108506 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-2fd459ca-0687-452a-b056-76148efddfb5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:37.198190 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [None req-2fd459ca-0687-452a-b056-76148efddfb5 admin admin] For port a1e57f2b-371b-4596-a39c-06e2d41d6dac, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=a1e57f2b-371b-4596-a39c-06e2d41d6dac,segment=NetworkSegment(5c66054f-77db-4a85-9c38-fb8c59887e07),segment_id=5c66054f-77db-4a85-9c38-fb8c59887e07)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:37.198677 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-2fd459ca-0687-452a-b056-76148efddfb5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:37.212099 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-2fd459ca-0687-452a-b056-76148efddfb5 admin admin] Calling delete_port for a1e57f2b-371b-4596-a39c-06e2d41d6dac owned by network:router_interface {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:37.332438 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-ecc3574d-f1d7-4342-b31f-45a025ee7b31 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:37.333935 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-ecc3574d-f1d7-4342-b31f-45a025ee7b31 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/networks?id=e593a34f-1f09-493d-aafd-a51b70c22643 HTTP/1.1" status: 200 len: 815 time: 0.1034906 Nov 21 13:58:37.349321 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-b823bbad-f9c2-42e9-944b-d67e961d7d52 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/quotas/48fbf7b5fd2347789241c7658fd6bb83 HTTP/1.1" status: 200 len: 375 time: 0.0097213 Nov 21 13:58:37.392190 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-2fd459ca-0687-452a-b056-76148efddfb5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:37.399841 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-02e7c52a-e33f-4d69-8bff-fbb7b6593192 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=48fbf7b5fd2347789241c7658fd6bb83&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0448642 Nov 21 13:58:37.420823 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd459ca-0687-452a-b056-76148efddfb5 admin admin] Pushing event deleted for resources: {'Port': ['ID=a1e57f2b-371b-4596-a39c-06e2d41d6dac,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:37.563615 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-cf56b0f7-b05c-4d83-95e7-c888b0ef406e service neutron] 10.222.0.11 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1562448 Nov 21 13:58:37.594785 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-2fd459ca-0687-452a-b056-76148efddfb5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1684491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-473209'] for router_interface, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:37.656052 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-16bacb1b-7bba-4700-8e96-c38d79a2b22b service neutron] 10.222.0.11 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856872 Nov 21 13:58:37.817808 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3298bcc7-c9bb-40a3-8e67-2283edc7ba1f req-e9d037aa-02ca-484e-a725-b3d0872d6ab3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 210 time: 0.0270655 Nov 21 13:58:37.833642 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2fd459ca-0687-452a-b056-76148efddfb5 admin admin] Router 93e91779-c8b9-44c0-97bb-b1f2a757239c has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:58:37.865139 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57360) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:37.956344 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2fd459ca-0687-452a-b056-76148efddfb5 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:58:37.961522 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-2fd459ca-0687-452a-b056-76148efddfb5 admin admin] 10.222.0.11 "PUT /v2.0/routers/93e91779-c8b9-44c0-97bb-b1f2a757239c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4541588 Nov 21 13:58:37.964092 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57368) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:37.967050 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41f2cd37-5364-4db6-b794-67648ca3bfd0 None None] Sync routers for ids ['93e91779-c8b9-44c0-97bb-b1f2a757239c'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:58:37.990780 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41f2cd37-5364-4db6-b794-67648ca3bfd0 None None] Routers {'93e91779-c8b9-44c0-97bb-b1f2a757239c'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:37.991663 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-41f2cd37-5364-4db6-b794-67648ca3bfd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:58:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['93e91779-c8b9-44c0-97bb-b1f2a757239c'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:38.084776 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Publish callbacks [] for router, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:38.113363 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-41f2cd37-5364-4db6-b794-67648ca3bfd0 None None] Set router 93e91779-c8b9-44c0-97bb-b1f2a757239c gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:38.201343 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:38.266972 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Deleting port f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:38.267598 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:38.330441 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-41f2cd37-5364-4db6-b794-67648ca3bfd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'name': 'tempest-TestShelveInstance-664246061-router', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30'}], 'enable_snat': True}, 'gw_port_id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:17Z', 'updated_at': '2021-11-21T13:58:37Z', 'revision_number': 5, 'project_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'gw_port': {'id': 'f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:b0:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 356, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.30', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:53:18Z', 'updated_at': '2021-11-21T13:53:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:38.363360 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41f2cd37-5364-4db6-b794-67648ca3bfd0 None None] Checking router: 93e91779-c8b9-44c0-97bb-b1f2a757239c for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:58:38.372877 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] For port f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:38.373095 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41f2cd37-5364-4db6-b794-67648ca3bfd0 None None] Routers {'93e91779-c8b9-44c0-97bb-b1f2a757239c'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:38.373302 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:38.373803 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-41f2cd37-5364-4db6-b794-67648ca3bfd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:58:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['93e91779-c8b9-44c0-97bb-b1f2a757239c'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:38.393038 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Calling delete_port for f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f owned by network:router_gateway {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:38.398864 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4540cf5f-a58e-42b6-8a90-aad6dd3c3338 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-473237'] for router_interface, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:38.483839 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-41f2cd37-5364-4db6-b794-67648ca3bfd0 None None] Set router 93e91779-c8b9-44c0-97bb-b1f2a757239c gateway port host: None {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:38.538427 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-41f2cd37-5364-4db6-b794-67648ca3bfd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'name': 'tempest-TestShelveInstance-664246061-router', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:17Z', 'updated_at': '2021-11-21T13:58:38Z', 'revision_number': 6, 'project_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'gw_port_host': None}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:38.571203 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41f2cd37-5364-4db6-b794-67648ca3bfd0 None None] The sync data for ids ['93e91779-c8b9-44c0-97bb-b1f2a757239c'] in dv-cinder-768458-12-iscsi is: [{'id': '93e91779-c8b9-44c0-97bb-b1f2a757239c', 'name': 'tempest-TestShelveInstance-664246061-router', 'tenant_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:53:17Z', 'updated_at': '2021-11-21T13:58:38Z', 'revision_number': 6, 'project_id': 'f4b2e564a45b45dd8e98fd102ec65206', 'gw_port_host': None}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:58:38.575836 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:38.602055 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Pushing event deleted for resources: {'Port': ['ID=f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:38.668471 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-471003'] for router_gateway, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:38.693193 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-4540cf5f-a58e-42b6-8a90-aad6dd3c3338 admin admin] Deleting port 352f29a9-b7fa-46f1-bcc4-584ce9176e66 {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:38.693753 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4540cf5f-a58e-42b6-8a90-aad6dd3c3338 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:38.759774 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-470817', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-58426'] for router, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:38.761970 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:38.776600 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-4540cf5f-a58e-42b6-8a90-aad6dd3c3338 admin admin] For port 352f29a9-b7fa-46f1-bcc4-584ce9176e66, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=352f29a9-b7fa-46f1-bcc4-584ce9176e66,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:38.776990 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4540cf5f-a58e-42b6-8a90-aad6dd3c3338 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:38.791120 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-4540cf5f-a58e-42b6-8a90-aad6dd3c3338 admin admin] Calling delete_port for 352f29a9-b7fa-46f1-bcc4-584ce9176e66 owned by network:router_interface {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:38.808997 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-470840'] for router, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:38.809562 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Fanout notify agent at l3_agent the message router_deleted on router 93e91779-c8b9-44c0-97bb-b1f2a757239c {{(pid=109041) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 21 13:58:38.814584 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] Publish callbacks [] for router, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:38.815750 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-6fd0dc19-3034-456a-9dc7-7534b14b42fd admin admin] 10.222.0.11 "DELETE /v2.0/routers/93e91779-c8b9-44c0-97bb-b1f2a757239c HTTP/1.1" status: 204 len: 168 time: 0.8505716 Nov 21 13:58:38.818388 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57372) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:38.945358 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-73d7e704-4efb-4a8c-b431-ff3b2095588e req-2831c26e-1791-4d25-85ee-372e70880b3d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 210 time: 0.0417879 Nov 21 13:58:38.953178 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_v2 [None req-9f80ba2c-8d82-4d1b-b269-13e05b6c57c6 admin admin] Deleting subnet 6f8e95bb-7134-4b19-812b-ae4abd04687c {{(pid=109041) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 13:58:38.976136 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9f80ba2c-8d82-4d1b-b269-13e05b6c57c6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.038402 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-0ab1e7e0-cbbf-46f6-8338-bb0c0ef7a077 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:39.039885 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-0ab1e7e0-cbbf-46f6-8338-bb0c0ef7a077 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "GET /v2.0/networks?id=e593a34f-1f09-493d-aafd-a51b70c22643 HTTP/1.1" status: 200 len: 815 time: 0.2130888 Nov 21 13:58:39.042743 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9f80ba2c-8d82-4d1b-b269-13e05b6c57c6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4028984'] for subnet, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.067858 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-1fe2cc11-d209-43ae-bf33-6c849229948f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Request body: {'port': {'device_id': '31a3c09e-663c-428c-8203-cb337ece6c85', 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643', 'admin_state_up': True, 'tenant_id': '48fbf7b5fd2347789241c7658fd6bb83'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:58:39.068982 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4540cf5f-a58e-42b6-8a90-aad6dd3c3338 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.093860 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4540cf5f-a58e-42b6-8a90-aad6dd3c3338 admin admin] Pushing event deleted for resources: {'Port': ['ID=352f29a9-b7fa-46f1-bcc4-584ce9176e66,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:39.198409 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9f80ba2c-8d82-4d1b-b269-13e05b6c57c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.259274 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-1fe2cc11-d209-43ae-bf33-6c849229948f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Made reservation on behalf of 48fbf7b5fd2347789241c7658fd6bb83 for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:58:39.263071 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-1fe2cc11-d209-43ae-bf33-6c849229948f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.268603 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4540cf5f-a58e-42b6-8a90-aad6dd3c3338 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1684491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-473209'] for router_interface, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.286982 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9f80ba2c-8d82-4d1b-b269-13e05b6c57c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3086848', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261005199'] for subnet, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.321809 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9f80ba2c-8d82-4d1b-b269-13e05b6c57c6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.324935 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-9f80ba2c-8d82-4d1b-b269-13e05b6c57c6 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/6f8e95bb-7134-4b19-812b-ae4abd04687c HTTP/1.1" status: 204 len: 168 time: 0.5056257 Nov 21 13:58:39.325952 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f80ba2c-8d82-4d1b-b269-13e05b6c57c6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6f8e95bb-7134-4b19-812b-ae4abd04687c,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:39.328338 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57380) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:39.330867 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e790848b-4857-4b61-ad57-c58d8d2af17a None None] Network 25ab6676-6dc6-4d22-bb7c-bd53e740870d requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:58:39.443333 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-1fe2cc11-d209-43ae-bf33-6c849229948f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Allocated IP 172.20.0.2 (e593a34f-1f09-493d-aafd-a51b70c22643/19a08397-ab57-46f7-b983-e6a3bc005bc2/88b1ce6e-bceb-48d2-9c83-267045746fd4) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:58:39.444989 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.549927 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1eaa7c7-cafb-483b-b61e-8828a620d17a None None] DHCP port deletion for 25ab6676-6dc6-4d22-bb7c-bd53e740870d request from dv-cinder-768458-12-iscsi {{(pid=109042) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 21 13:58:39.596373 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4540cf5f-a58e-42b6-8a90-aad6dd3c3338 admin admin] Router 0f049428-3827-4a0f-9254-57ee6dba40c0 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 13:58:39.606646 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-d1eaa7c7-cafb-483b-b61e-8828a620d17a None None] Deleting port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d {{(pid=109042) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:39.607321 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d1eaa7c7-cafb-483b-b61e-8828a620d17a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.607729 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-1fe2cc11-d209-43ae-bf33-6c849229948f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.608233 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Deleting port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:39.608388 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.642918 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-1fe2cc11-d209-43ae-bf33-6c849229948f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.658518 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['311b993c-d963-4bbd-9dd2-91f64ff1d918', 'cee3a926-deeb-40c7-8cda-e34f3786308a'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:58:39.696547 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-1fe2cc11-d209-43ae-bf33-6c849229948f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Network e593a34f-1f09-493d-aafd-a51b70c22643 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:58:39.699737 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-1fe2cc11-d209-43ae-bf33-6c849229948f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:58:39.704828 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-1fe2cc11-d209-43ae-bf33-6c849229948f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:58:39.707773 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-d1eaa7c7-cafb-483b-b61e-8828a620d17a None None] For port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=c9a4cdd6-e0fd-4e22-8872-e12b30fb970d,segment=NetworkSegment(5c66054f-77db-4a85-9c38-fb8c59887e07),segment_id=5c66054f-77db-4a85-9c38-fb8c59887e07)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:39.708066 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d1eaa7c7-cafb-483b-b61e-8828a620d17a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.726577 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-d1eaa7c7-cafb-483b-b61e-8828a620d17a None None] Calling delete_port for c9a4cdd6-e0fd-4e22-8872-e12b30fb970d owned by network:dhcp {{(pid=109042) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:39.733911 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fe2cc11-d209-43ae-bf33-6c849229948f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Pushing event updated for resources: {'Port': ['ID=88b1ce6e-bceb-48d2-9c83-267045746fd4,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:39.762277 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] For port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=c9a4cdd6-e0fd-4e22-8872-e12b30fb970d,segment=NetworkSegment(5c66054f-77db-4a85-9c38-fb8c59887e07),segment_id=5c66054f-77db-4a85-9c38-fb8c59887e07)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:39.762851 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.765989 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-1fe2cc11-d209-43ae-bf33-6c849229948f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:39.767140 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-1fe2cc11-d209-43ae-bf33-6c849229948f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.782208 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Calling delete_port for c9a4cdd6-e0fd-4e22-8872-e12b30fb970d owned by network:dhcp {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:39.788335 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-1fe2cc11-d209-43ae-bf33-6c849229948f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7263267 Nov 21 13:58:39.798854 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4540cf5f-a58e-42b6-8a90-aad6dd3c3338 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 13:58:39.807439 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-4540cf5f-a58e-42b6-8a90-aad6dd3c3338 admin admin] 10.222.0.11 "PUT /v2.0/routers/0f049428-3827-4a0f-9254-57ee6dba40c0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9408920 Nov 21 13:58:39.808720 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57382) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:39.809454 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74af158e-e918-40c5-b053-2a87e4e89906 None None] Sync routers for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 13:58:39.819031 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Request body: {'port': {'device_id': '31a3c09e-663c-428c-8203-cb337ece6c85', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:58:39.822441 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74af158e-e918-40c5-b053-2a87e4e89906 None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:39.823303 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-74af158e-e918-40c5-b053-2a87e4e89906 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:58:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:39.933742 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.948521 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d1eaa7c7-cafb-483b-b61e-8828a620d17a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855'] for port, after_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:39.960635 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-74af158e-e918-40c5-b053-2a87e4e89906 None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:39.969923 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1eaa7c7-cafb-483b-b61e-8828a620d17a None None] No DVR routers for this DVR port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d on host dv-cinder-768458-12-iscsi {{(pid=109042) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:58:39.985356 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Publish callbacks [] for router, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.010010 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1eaa7c7-cafb-483b-b61e-8828a620d17a None None] Pushing event deleted for resources: {'Port': ['ID=c9a4cdd6-e0fd-4e22-8872-e12b30fb970d,revision_number=None']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:40.049936 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.210408 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-74af158e-e918-40c5-b053-2a87e4e89906 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:58:39Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:40.236785 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74af158e-e918-40c5-b053-2a87e4e89906 None None] Checking router: 0f049428-3827-4a0f-9254-57ee6dba40c0 for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 13:58:40.241729 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 88b1ce6e-bceb-48d2-9c83-267045746fd4 {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:58:40.246007 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74af158e-e918-40c5-b053-2a87e4e89906 None None] Routers {'0f049428-3827-4a0f-9254-57ee6dba40c0'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 13:58:40.246752 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-74af158e-e918-40c5-b053-2a87e4e89906 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T13:58:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['0f049428-3827-4a0f-9254-57ee6dba40c0'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:40.251035 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.263622 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Transition to ACTIVE for port object 88b1ce6e-bceb-48d2-9c83-267045746fd4 will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:58:40.272880 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.357322 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-74af158e-e918-40c5-b053-2a87e4e89906 None None] Set router 0f049428-3827-4a0f-9254-57ee6dba40c0 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 13:58:40.364069 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Pushing event deleted for resources: {'Port': ['ID=c9a4cdd6-e0fd-4e22-8872-e12b30fb970d,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:40.364959 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] No DVR routers for this DVR port c9a4cdd6-e0fd-4e22-8872-e12b30fb970d on host dv-cinder-768458-12-iscsi {{(pid=109040) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:58:40.485806 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.490637 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.502712 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58fb7202-d3c4-4855-b97b-bb834e30f94b req-b2924f1a-fc6a-4911-8620-6c381505c7ec tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:40.504842 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-58fb7202-d3c4-4855-b97b-bb834e30f94b req-b2924f1a-fc6a-4911-8620-6c381505c7ec tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 943 time: 0.4406331 Nov 21 13:58:40.543896 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['25ab6676-6dc6-4d22-bb7c-bd53e740870d']}} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:40.572341 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5c66054f-77db-4a85-9c38-fb8c59887e07') {'for_net_delete': True} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:40.572708 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5c66054f-77db-4a85-9c38-fb8c59887e07') {} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:40.586058 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-74af158e-e918-40c5-b053-2a87e4e89906 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:58:39Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:40.599033 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-261998924'] for segment, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.599209 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:40.620854 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:40.621609 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device f8d5ad9b-f1c7-4ffa-bab5-56c00f4cb38f not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:40.622334 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device c9a4cdd6-e0fd-4e22-8872-e12b30fb970d no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:40.624177 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-58fb7202-d3c4-4855-b97b-bb834e30f94b req-ee36f716-4ef9-4fc4-b4a4-4998b1e613e8 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1103539 Nov 21 13:58:40.625138 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.629011 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74af158e-e918-40c5-b053-2a87e4e89906 None None] The sync data for ids ['0f049428-3827-4a0f-9254-57ee6dba40c0'] in dv-cinder-768458-12-iscsi is: [{'id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'name': 'tempest-AttachVolumeShelveTestJSON-1638133604-router', 'tenant_id': '3d25ecbdc2ba435488271022d897a406', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T13:51:41Z', 'updated_at': '2021-11-21T13:58:39Z', 'revision_number': 5, 'project_id': '3d25ecbdc2ba435488271022d897a406', 'gw_port': {'id': 'eda329ac-a209-4da8-b74f-a5e6cc6eb19c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:15:05:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f049428-3827-4a0f-9254-57ee6dba40c0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T13:51:43Z', 'updated_at': '2021-11-21T13:51:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 13:58:40.634924 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Releasing vlan 503 on physical network physnet1 to pool {{(pid=109040) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 13:58:40.634924 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2298122'] for segment, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: Traceback (most recent call last): Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: timer() Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: cb(*args, **kw) Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: return func(*args, **kwargs) Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: self._notify() Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: self.callback(batched_events) Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: event.method(event) Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: return f(self, *a, **k) Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._get(url).json() Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: return self.request(url, 'GET', **kwargs) Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 13:58:40.636408 dv-cinder-768458-12-iscsi neutron-server[109040]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 13:58:40.652778 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: c9a4cdd6-e0fd-4e22-8872-e12b30fb970d {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:40.653244 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device c9a4cdd6-e0fd-4e22-8872-e12b30fb970d not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:40.653760 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device a1e57f2b-371b-4596-a39c-06e2d41d6dac no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:40.655665 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Pushing event updated for resources: {'Port': ['ID=88b1ce6e-bceb-48d2-9c83-267045746fd4,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:40.693392 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: a1e57f2b-371b-4596-a39c-06e2d41d6dac {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:40.694227 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device a1e57f2b-371b-4596-a39c-06e2d41d6dac not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:40.708685 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Deleting port eda329ac-a209-4da8-b74f-a5e6cc6eb19c {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:40.709024 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.743765 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.748033 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Attempting to bind port 88b1ce6e-bceb-48d2-9c83-267045746fd4 on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:58:40.748821 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Attempting to bind port 88b1ce6e-bceb-48d2-9c83-267045746fd4 by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:58:40.749325 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Attempting to bind port 88b1ce6e-bceb-48d2-9c83-267045746fd4 on network e593a34f-1f09-493d-aafd-a51b70c22643 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:58:40.750687 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.756645 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] 10.222.0.11 "DELETE /v2.0/networks/25ab6676-6dc6-4d22-bb7c-bd53e740870d HTTP/1.1" status: 204 len: 168 time: 1.4245279 Nov 21 13:58:40.756819 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Port 88b1ce6e-bceb-48d2-9c83-267045746fd4 on network e593a34f-1f09-493d-aafd-a51b70c22643 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:58:40.756819 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Attempting to bind port 88b1ce6e-bceb-48d2-9c83-267045746fd4 on network e593a34f-1f09-493d-aafd-a51b70c22643 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:58:40.760606 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 58, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:58:40.761048 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Checking segment: {'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:58:40.761506 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Bound using segment: {'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:58:40.762089 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Bound port: 88b1ce6e-bceb-48d2-9c83-267045746fd4, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:58:40.762592 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.767919 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08d30962-8f99-469d-b3ab-31208db24642 admin admin] Pushing event deleted for resources: {'Network': ['ID=25ab6676-6dc6-4d22-bb7c-bd53e740870d,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:40.809686 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] For port eda329ac-a209-4da8-b74f-a5e6cc6eb19c, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=eda329ac-a209-4da8-b74f-a5e6cc6eb19c,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:40.810056 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.824430 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Calling delete_port for eda329ac-a209-4da8-b74f-a5e6cc6eb19c owned by network:router_gateway {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:40.838354 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] For port 88b1ce6e-bceb-48d2-9c83-267045746fd4, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:58:40.841628 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] For port 88b1ce6e-bceb-48d2-9c83-267045746fd4, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=88b1ce6e-bceb-48d2-9c83-267045746fd4,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:58:40.846700 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.886075 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:40.886698 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:40.888114 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] 10.222.0.50 "PUT /v2.0/ports/88b1ce6e-bceb-48d2-9c83-267045746fd4 HTTP/1.1" status: 200 len: 1093 time: 1.0896690 Nov 21 13:58:40.888555 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '31a3c09e-663c-428c-8203-cb337ece6c85', 'tag': '88b1ce6e-bceb-48d2-9c83-267045746fd4'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:58:40.890875 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-70a57b00-35ca-4e48-aaeb-9439f9f06563" -d '{"events": [{"name": "network-changed", "server_uuid": "31a3c09e-663c-428c-8203-cb337ece6c85", "tag": "88b1ce6e-bceb-48d2-9c83-267045746fd4"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:58:40.895333 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57390) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:40.913531 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63250ecf-ef6f-4bf0-ae61-d10fe32de13d service neutron] Pushing event updated for resources: {'Port': ['ID=88b1ce6e-bceb-48d2-9c83-267045746fd4,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:40.949588 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:58:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c506e599-835a-40c0-95fc-464c5cc81af8 x-openstack-request-id: req-c506e599-835a-40c0-95fc-464c5cc81af8 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:58:40.949991 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "31a3c09e-663c-428c-8203-cb337ece6c85", "tag": "88b1ce6e-bceb-48d2-9c83-267045746fd4", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:58:40.950250 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-c506e599-835a-40c0-95fc-464c5cc81af8 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:58:40.950638 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '31a3c09e-663c-428c-8203-cb337ece6c85', 'tag': '88b1ce6e-bceb-48d2-9c83-267045746fd4', 'status': 'completed', 'code': 200} Nov 21 13:58:40.981373 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-675dabe6-4383-4b7b-8d24-7887470b829c admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=3f91d0ec3fb5421aa1fb95a0cb0d040d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0850856 Nov 21 13:58:40.984683 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57392) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:40.986707 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-6c240e02-5c1b-4bae-92bf-d5a40a9c9d82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:40.988268 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-6c240e02-5c1b-4bae-92bf-d5a40a9c9d82 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=48fbf7b5fd2347789241c7658fd6bb83&device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 1096 time: 0.0484352 Nov 21 13:58:41.035684 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-da998041-cd53-4ad3-b032-443552a946cc service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=88b1ce6e-bceb-48d2-9c83-267045746fd4 HTTP/1.1" status: 200 len: 217 time: 0.0389616 Nov 21 13:58:41.092236 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-a280dd7e-c8fd-4ce9-86c7-d36f99a2cac5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:41.093859 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-a280dd7e-c8fd-4ce9-86c7-d36f99a2cac5 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=19a08397-ab57-46f7-b983-e6a3bc005bc2 HTTP/1.1" status: 200 len: 855 time: 0.0508432 Nov 21 13:58:41.097156 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-758c8afe-1b82-4dc4-a1d3-abbd089d9a9c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.103823 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.129020 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-67f9e8a6-b23f-4188-9cf1-b04fd918ecf3 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=e593a34f-1f09-493d-aafd-a51b70c22643&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0263033 Nov 21 13:58:41.146685 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Pushing event deleted for resources: {'Port': ['ID=eda329ac-a209-4da8-b74f-a5e6cc6eb19c,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:41.154451 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-758c8afe-1b82-4dc4-a1d3-abbd089d9a9c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.232704 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-d6bd1c7f-05c5-4e93-a494-0bde595fcffc service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0959840 Nov 21 13:58:41.233543 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-471003'] for router_gateway, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.328977 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-758c8afe-1b82-4dc4-a1d3-abbd089d9a9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.331785 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-758c8afe-1b82-4dc4-a1d3-abbd089d9a9c admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.335390 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-758c8afe-1b82-4dc4-a1d3-abbd089d9a9c admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/341ccf65-51a5-469f-80f4-987e02141178 HTTP/1.1" status: 204 len: 168 time: 0.3474698 Nov 21 13:58:41.335390 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-470817', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-58426'] for router, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.338733 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.348950 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-758c8afe-1b82-4dc4-a1d3-abbd089d9a9c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=341ccf65-51a5-469f-80f4-987e02141178,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:41.393375 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-470840'] for router, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.394241 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0f049428-3827-4a0f-9254-57ee6dba40c0 {{(pid=109040) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 21 13:58:41.398821 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3227df01-c3ba-4fca-8b50-1954cf28c859 req-e56f3651-bb2c-4640-a70e-c7affa691df6 service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0903897 Nov 21 13:58:41.399649 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] Publish callbacks [] for router, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.400850 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-acd0afaf-b5e4-4c0c-8d33-5b3e1b47e039 admin admin] 10.222.0.11 "DELETE /v2.0/routers/0f049428-3827-4a0f-9254-57ee6dba40c0 HTTP/1.1" status: 204 len: 168 time: 1.5902247 Nov 21 13:58:41.403602 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57396) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:41.466068 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_v2 [None req-ba25ebab-e5ae-4569-a91a-3c7c8cf29d78 admin admin] Deleting subnet c4887ea6-9c0e-4a7b-bd51-d70b335ceb92 {{(pid=109041) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 13:58:41.482509 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ba25ebab-e5ae-4569-a91a-3c7c8cf29d78 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.549411 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ba25ebab-e5ae-4569-a91a-3c7c8cf29d78 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4028984'] for subnet, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.574810 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-0e09d670-dc5d-43f1-b14c-1f797e97c010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:41.576402 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-0e09d670-dc5d-43f1-b14c-1f797e97c010 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=48fbf7b5fd2347789241c7658fd6bb83&device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 1096 time: 0.1063023 Nov 21 13:58:41.693501 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ba25ebab-e5ae-4569-a91a-3c7c8cf29d78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.724466 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57402) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:41.749465 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-b5fe79e7-3885-4ac6-94b4-e343af1f70f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:41.750907 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-b5fe79e7-3885-4ac6-94b4-e343af1f70f7 service neutron] 10.222.0.50 "GET /v2.0/networks?id=e593a34f-1f09-493d-aafd-a51b70c22643 HTTP/1.1" status: 200 len: 916 time: 0.1632345 Nov 21 13:58:41.755252 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a7e6358-c229-40b6-9387-32d7f025b32c req-64450af6-4ef7-429d-9c64-ea552056e6a4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:41.756945 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7a7e6358-c229-40b6-9387-32d7f025b32c req-64450af6-4ef7-429d-9c64-ea552056e6a4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 943 time: 0.0540249 Nov 21 13:58:41.812875 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7a7e6358-c229-40b6-9387-32d7f025b32c req-b599183f-eda8-4682-bf9b-4144ecc6de07 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486822 Nov 21 13:58:41.826301 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-41aeb3dc-03f9-4886-b9b8-f7d1f1837c53 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=88b1ce6e-bceb-48d2-9c83-267045746fd4 HTTP/1.1" status: 200 len: 217 time: 0.0554810 Nov 21 13:58:41.829884 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-18ec4620-01de-41db-b01c-3c23e4ddd5f0 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=f4b2e564a45b45dd8e98fd102ec65206&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1030922 Nov 21 13:58:41.831326 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ba25ebab-e5ae-4569-a91a-3c7c8cf29d78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3086848', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261005199'] for subnet, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.832861 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57404) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:41.865819 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba25ebab-e5ae-4569-a91a-3c7c8cf29d78 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c4887ea6-9c0e-4a7b-bd51-d70b335ceb92,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:41.878756 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8617470a-11fb-4419-aaa0-6487ccb19447 None None] Network 24c864ef-5c5a-4df8-8968-78a7fe30b188 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:58:41.886641 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ba25ebab-e5ae-4569-a91a-3c7c8cf29d78 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.889857 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-ba25ebab-e5ae-4569-a91a-3c7c8cf29d78 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/c4887ea6-9c0e-4a7b-bd51-d70b335ceb92 HTTP/1.1" status: 204 len: 168 time: 0.4851301 Nov 21 13:58:41.894929 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57406) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:41.901815 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e6b84858-51e4-4838-8b54-f1c9705e8bda admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.914754 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-2d79e162-6d23-4ba7-abd9-47bd9c38b1bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:41.916162 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-2d79e162-6d23-4ba7-abd9-47bd9c38b1bb service neutron] 10.222.0.50 "GET /v2.0/subnets?id=19a08397-ab57-46f7-b983-e6a3bc005bc2 HTTP/1.1" status: 200 len: 855 time: 0.0763297 Nov 21 13:58:41.960699 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-dd43757b-6adf-4142-be01-d82ea0499e89 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=e593a34f-1f09-493d-aafd-a51b70c22643&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0321877 Nov 21 13:58:41.970193 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e6b84858-51e4-4838-8b54-f1c9705e8bda admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:41.995604 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.070304 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e6b84858-51e4-4838-8b54-f1c9705e8bda admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.073209 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e6b84858-51e4-4838-8b54-f1c9705e8bda admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.077048 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-e6b84858-51e4-4838-8b54-f1c9705e8bda admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ef10eb9f-adfc-4b73-b6a3-753eb02e3787 HTTP/1.1" status: 204 len: 168 time: 0.2406416 Nov 21 13:58:42.080380 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-56fb22f0-3a30-4b84-a644-d197ed939649 service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1092451 Nov 21 13:58:42.086498 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6b84858-51e4-4838-8b54-f1c9705e8bda admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef10eb9f-adfc-4b73-b6a3-753eb02e3787,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:42.100489 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c125302f-5056-432b-a8b5-faf9b61fce2a None None] DHCP port deletion for 24c864ef-5c5a-4df8-8968-78a7fe30b188 request from dv-cinder-768458-12-iscsi {{(pid=109042) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 21 13:58:42.112480 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Deleting port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:42.113522 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.180390 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-c125302f-5056-432b-a8b5-faf9b61fce2a None None] Deleting port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff {{(pid=109042) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:58:42.181240 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c125302f-5056-432b-a8b5-faf9b61fce2a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.191068 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-70a57b00-35ca-4e48-aaeb-9439f9f06563 req-07105716-3da8-40e6-a742-15cbcb51ae8f service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1011713 Nov 21 13:58:42.196575 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] For port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:42.196771 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.212206 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Calling delete_port for da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff owned by network:dhcp {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:42.254608 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-c125302f-5056-432b-a8b5-faf9b61fce2a None None] For port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff,segment=NetworkSegment(1366d621-cbe7-4737-8733-1d29712acbd0),segment_id=1366d621-cbe7-4737-8733-1d29712acbd0)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:42.255147 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c125302f-5056-432b-a8b5-faf9b61fce2a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.280369 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-c125302f-5056-432b-a8b5-faf9b61fce2a None None] Calling delete_port for da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff owned by network:dhcp {{(pid=109042) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:58:42.301626 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.329784 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Pushing event deleted for resources: {'Port': ['ID=da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:42.333763 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] No DVR routers for this DVR port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff on host dv-cinder-768458-12-iscsi {{(pid=109040) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:58:42.384794 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c125302f-5056-432b-a8b5-faf9b61fce2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855'] for port, after_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.420841 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c125302f-5056-432b-a8b5-faf9b61fce2a None None] Pushing event deleted for resources: {'Port': ['ID=da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff,revision_number=None']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:42.421789 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.426378 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c125302f-5056-432b-a8b5-faf9b61fce2a None None] No DVR routers for this DVR port da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff on host dv-cinder-768458-12-iscsi {{(pid=109042) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:58:42.453720 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['24c864ef-5c5a-4df8-8968-78a7fe30b188']}} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:42.456281 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device eda329ac-a209-4da8-b74f-a5e6cc6eb19c no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:42.464926 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1366d621-cbe7-4737-8733-1d29712acbd0') {'for_net_delete': True} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:42.465226 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1366d621-cbe7-4737-8733-1d29712acbd0') {} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:58:42.476863 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-261998924'] for segment, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.485275 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: eda329ac-a209-4da8-b74f-a5e6cc6eb19c {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:42.485895 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device eda329ac-a209-4da8-b74f-a5e6cc6eb19c not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:42.486515 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:42.490869 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.497417 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Releasing vlan 524 on physical network physnet1 to pool {{(pid=109040) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 13:58:42.497821 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2298122'] for segment, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: Traceback (most recent call last): Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: timer() Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: cb(*args, **kw) Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: return func(*args, **kwargs) Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: self._notify() Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: self.callback(batched_events) Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: event.method(event) Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: return f(self, *a, **k) Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._get(url).json() Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: return self.request(url, 'GET', **kwargs) Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 13:58:42.500503 dv-cinder-768458-12-iscsi neutron-server[109040]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 13:58:42.516926 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:42.517418 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device da1ce5ee-fa12-42ab-89f1-80aa0ba8cbff not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:42.517958 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 352f29a9-b7fa-46f1-bcc4-584ce9176e66 no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:58:42.537072 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: 352f29a9-b7fa-46f1-bcc4-584ce9176e66 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:58:42.537413 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 352f29a9-b7fa-46f1-bcc4-584ce9176e66 not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:58:42.559301 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.566356 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.569662 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] 10.222.0.11 "DELETE /v2.0/networks/24c864ef-5c5a-4df8-8968-78a7fe30b188 HTTP/1.1" status: 204 len: 168 time: 0.6735661 Nov 21 13:58:42.579063 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9b964f5-0cac-4175-876e-4aa560b064b1 admin admin] Pushing event deleted for resources: {'Network': ['ID=24c864ef-5c5a-4df8-8968-78a7fe30b188,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:42.728901 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57412) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:42.767556 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-42ef2e26-fe9e-4dd1-9171-71c57fb18462 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=3d25ecbdc2ba435488271022d897a406&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0375319 Nov 21 13:58:42.769876 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57414) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:42.814616 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2967087b-a57c-4a22-bf95-0bf36019b0a4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.836782 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2967087b-a57c-4a22-bf95-0bf36019b0a4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.888567 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2967087b-a57c-4a22-bf95-0bf36019b0a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.891316 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-2967087b-a57c-4a22-bf95-0bf36019b0a4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:42.892570 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-2967087b-a57c-4a22-bf95-0bf36019b0a4 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/8f54dc64-b6a0-4ca7-9ae7-78927108af9d HTTP/1.1" status: 204 len: 168 time: 0.1218209 Nov 21 13:58:42.901219 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2967087b-a57c-4a22-bf95-0bf36019b0a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f54dc64-b6a0-4ca7-9ae7-78927108af9d,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:42.947582 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d9197cd-6c72-4e3a-a22c-2fb5f20cb751 req-741936c4-2de7-482a-bf70-ada025142e4d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:42.949073 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6d9197cd-6c72-4e3a-a22c-2fb5f20cb751 req-741936c4-2de7-482a-bf70-ada025142e4d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 943 time: 0.0654995 Nov 21 13:58:42.997517 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6d9197cd-6c72-4e3a-a22c-2fb5f20cb751 req-afddcafa-766f-4ecb-b825-5527e512c37f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418885 Nov 21 13:58:43.254000 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 88b1ce6e-bceb-48d2-9c83-267045746fd4 details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:58:43.380385 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 88b1ce6e-bceb-48d2-9c83-267045746fd4, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=88b1ce6e-bceb-48d2-9c83-267045746fd4,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:43.395086 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '88b1ce6e-bceb-48d2-9c83-267045746fd4', 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643', 'port_id': '88b1ce6e-bceb-48d2-9c83-267045746fd4', 'mac_address': 'fa:16:3e:89:44:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 511, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '19a08397-ab57-46f7-b983-e6a3bc005bc2', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:58:43.432589 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:43.445113 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 88b1ce6e-bceb-48d2-9c83-267045746fd4 {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:58:43.465049 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 88b1ce6e-bceb-48d2-9c83-267045746fd4, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=88b1ce6e-bceb-48d2-9c83-267045746fd4,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:43.469513 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:43.518079 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=88b1ce6e-bceb-48d2-9c83-267045746fd4,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:43.714260 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['88b1ce6e-bceb-48d2-9c83-267045746fd4'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:58:44.110762 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a46d6d1-5dd2-4d43-87f4-2568dcbbb63d req-8b719f0e-1912-49fd-a604-5471f18bc13d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:44.112411 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2a46d6d1-5dd2-4d43-87f4-2568dcbbb63d req-8b719f0e-1912-49fd-a604-5471f18bc13d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 944 time: 0.0486875 Nov 21 13:58:44.160486 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2a46d6d1-5dd2-4d43-87f4-2568dcbbb63d req-de4fa15f-08df-4461-be81-29c50249d59a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419133 Nov 21 13:58:44.569196 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57468) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:44.671241 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6e999677-05b9-45d7-91e0-d4e84f955ccd admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:44.742865 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6e999677-05b9-45d7-91e0-d4e84f955ccd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:44.746519 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6e999677-05b9-45d7-91e0-d4e84f955ccd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:44.783186 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-6e999677-05b9-45d7-91e0-d4e84f955ccd admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7bf362cf5b874d8aa8b6f1f67c968e33&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2129269 Nov 21 13:58:44.784119 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e999677-05b9-45d7-91e0-d4e84f955ccd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ff42af9-40a8-4a60-abbf-0cd5d9fd190e,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:44.785878 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57472) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:44.840684 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0838ca84-6119-4dd6-bc0d-00933433cb6f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:44.863534 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0838ca84-6119-4dd6-bc0d-00933433cb6f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:44.908604 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0838ca84-6119-4dd6-bc0d-00933433cb6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:44.911299 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0838ca84-6119-4dd6-bc0d-00933433cb6f admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:44.912479 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-0838ca84-6119-4dd6-bc0d-00933433cb6f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/4ff42af9-40a8-4a60-abbf-0cd5d9fd190e HTTP/1.1" status: 204 len: 168 time: 0.1256030 Nov 21 13:58:44.919674 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0838ca84-6119-4dd6-bc0d-00933433cb6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ff42af9-40a8-4a60-abbf-0cd5d9fd190e,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:45.164213 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57478) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:45.177446 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-55f4ed0f-2087-42f9-9d9c-e01bbfe1bdb1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:45.266851 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 88b1ce6e-bceb-48d2-9c83-267045746fd4 up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:58:45.282465 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-55f4ed0f-2087-42f9-9d9c-e01bbfe1bdb1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:45.291146 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-55f4ed0f-2087-42f9-9d9c-e01bbfe1bdb1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:45.309021 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e85a197f-d381-43ca-96d7-1987fa7f46e1 req-311fda19-a691-44c2-89f9-102cfc4c3d5d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:45.310496 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e85a197f-d381-43ca-96d7-1987fa7f46e1 req-311fda19-a691-44c2-89f9-102cfc4c3d5d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 944 time: 0.0815127 Nov 21 13:58:45.317077 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port 88b1ce6e-bceb-48d2-9c83-267045746fd4 completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:58:45.321860 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 88b1ce6e-bceb-48d2-9c83-267045746fd4 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:58:45.322312 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:45.355162 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-55f4ed0f-2087-42f9-9d9c-e01bbfe1bdb1 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=76cae99eaafc466f820de01235af095b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1898496 Nov 21 13:58:45.358928 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57482) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:45.359790 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55f4ed0f-2087-42f9-9d9c-e01bbfe1bdb1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af78cd57-ddb7-4b24-bc99-171c8e9fbfd4,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:45.389098 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e85a197f-d381-43ca-96d7-1987fa7f46e1 req-4e52f4a0-381d-41b1-a979-9e69a0b5eccc tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708261 Nov 21 13:58:45.415831 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:45.417434 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1d2786e2-d5fe-4120-abc1-3424fa4c238c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:45.438826 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1d2786e2-d5fe-4120-abc1-3424fa4c238c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:45.440210 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31a3c09e-663c-428c-8203-cb337ece6c85', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '88b1ce6e-bceb-48d2-9c83-267045746fd4'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:58:45.442609 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eeb9e767-9d00-415f-b3b4-6e597a8e1436" -d '{"events": [{"server_uuid": "31a3c09e-663c-428c-8203-cb337ece6c85", "name": "network-vif-plugged", "status": "completed", "tag": "88b1ce6e-bceb-48d2-9c83-267045746fd4"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:58:45.456100 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 88b1ce6e-bceb-48d2-9c83-267045746fd4, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=88b1ce6e-bceb-48d2-9c83-267045746fd4,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:58:45.461617 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:45.487084 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:58:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c285f952-9fc9-4ded-a011-a19e647801e5 x-openstack-request-id: req-c285f952-9fc9-4ded-a011-a19e647801e5 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:58:45.487377 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "31a3c09e-663c-428c-8203-cb337ece6c85", "name": "network-vif-plugged", "status": "completed", "tag": "88b1ce6e-bceb-48d2-9c83-267045746fd4", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:58:45.487633 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-c285f952-9fc9-4ded-a011-a19e647801e5 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:58:45.488072 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '31a3c09e-663c-428c-8203-cb337ece6c85', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '88b1ce6e-bceb-48d2-9c83-267045746fd4', 'code': 200} Nov 21 13:58:45.489608 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1d2786e2-d5fe-4120-abc1-3424fa4c238c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:45.492536 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-1d2786e2-d5fe-4120-abc1-3424fa4c238c admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:45.496003 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-1d2786e2-d5fe-4120-abc1-3424fa4c238c admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/af78cd57-ddb7-4b24-bc99-171c8e9fbfd4 HTTP/1.1" status: 204 len: 168 time: 0.1324060 Nov 21 13:58:45.502966 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d2786e2-d5fe-4120-abc1-3424fa4c238c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af78cd57-ddb7-4b24-bc99-171c8e9fbfd4,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:45.528092 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=88b1ce6e-bceb-48d2-9c83-267045746fd4,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:45.680764 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45238ff3-53d7-4c61-adce-f9b4278914ae req-253078c4-7d44-451b-aaee-032820363a6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:45.682246 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-45238ff3-53d7-4c61-adce-f9b4278914ae req-253078c4-7d44-451b-aaee-032820363a6b service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 1098 time: 0.0401680 Nov 21 13:58:45.732695 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-45238ff3-53d7-4c61-adce-f9b4278914ae req-d16cc714-e60f-4656-bb0b-c50dd3039f93 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378771 Nov 21 13:58:46.509131 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2954cf3c-ee04-4492-aee9-96f057071143 req-b55f370f-dd90-4cd0-ad86-a06ebe63b985 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:46.510606 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2954cf3c-ee04-4492-aee9-96f057071143 req-b55f370f-dd90-4cd0-ad86-a06ebe63b985 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 945 time: 0.0521450 Nov 21 13:58:46.558682 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2954cf3c-ee04-4492-aee9-96f057071143 req-a0ef1206-e248-4aa6-bb51-607d7a2772ff tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416679 Nov 21 13:58:47.035357 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57530) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:47.141307 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-50e6c59c-df7b-4433-8605-c7623d0878c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.214335 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-50e6c59c-df7b-4433-8605-c7623d0878c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.217964 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-50e6c59c-df7b-4433-8605-c7623d0878c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.257182 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-50e6c59c-df7b-4433-8605-c7623d0878c2 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=289ce3ac2d1b401ea50f6d6c226a7271&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2207088 Nov 21 13:58:47.258108 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50e6c59c-df7b-4433-8605-c7623d0878c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c990906-c3c4-4220-bde9-42239cb56dec,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:47.259822 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57534) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:47.308287 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9c9a1d69-97c0-4654-b59f-de2775d4b1bc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.329133 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9c9a1d69-97c0-4654-b59f-de2775d4b1bc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.373687 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9c9a1d69-97c0-4654-b59f-de2775d4b1bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.376325 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9c9a1d69-97c0-4654-b59f-de2775d4b1bc admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.377484 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-9c9a1d69-97c0-4654-b59f-de2775d4b1bc admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/1c990906-c3c4-4220-bde9-42239cb56dec HTTP/1.1" status: 204 len: 168 time: 0.1160693 Nov 21 13:58:47.385164 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c9a1d69-97c0-4654-b59f-de2775d4b1bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c990906-c3c4-4220-bde9-42239cb56dec,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:47.635011 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57542) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:47.648807 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-268cb9e1-fdb2-4a5a-8780-4407fb5130b7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.675345 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22c6e7ee-6169-4d46-b712-f952a2762a7b req-d00ac810-bf03-42c4-ba1b-69b384522506 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:47.676864 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-22c6e7ee-6169-4d46-b712-f952a2762a7b req-d00ac810-bf03-42c4-ba1b-69b384522506 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 945 time: 0.0486205 Nov 21 13:58:47.722559 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-268cb9e1-fdb2-4a5a-8780-4407fb5130b7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.726759 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-268cb9e1-fdb2-4a5a-8780-4407fb5130b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.729641 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-22c6e7ee-6169-4d46-b712-f952a2762a7b req-87507cdc-f238-4f9a-a646-622f7ae24dce tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459747 Nov 21 13:58:47.771239 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-268cb9e1-fdb2-4a5a-8780-4407fb5130b7 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=437aa96618af4354b2c3e9e78a6c1061&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1326823 Nov 21 13:58:47.771239 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-268cb9e1-fdb2-4a5a-8780-4407fb5130b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=80310fbc-e1ca-4244-8b7b-9f463ff58b9e,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:47.772135 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57546) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:47.820747 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9fc10a9c-610e-4661-b45f-5ea6dae218f5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.844930 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9fc10a9c-610e-4661-b45f-5ea6dae218f5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.893147 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9fc10a9c-610e-4661-b45f-5ea6dae218f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.895928 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-9fc10a9c-610e-4661-b45f-5ea6dae218f5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:47.899761 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-9fc10a9c-610e-4661-b45f-5ea6dae218f5 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/80310fbc-e1ca-4244-8b7b-9f463ff58b9e HTTP/1.1" status: 204 len: 168 time: 0.1238499 Nov 21 13:58:47.906197 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc10a9c-610e-4661-b45f-5ea6dae218f5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=80310fbc-e1ca-4244-8b7b-9f463ff58b9e,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:52.600934 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.103919 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57690) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:54.205724 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ca9d4bab-05ff-455e-9019-227d5582a1b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.276909 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ca9d4bab-05ff-455e-9019-227d5582a1b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.281093 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-ca9d4bab-05ff-455e-9019-227d5582a1b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.318265 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-ca9d4bab-05ff-455e-9019-227d5582a1b3 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=17470f60707646bdbe2c77ccba5b0674&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2132242 Nov 21 13:58:54.319299 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca9d4bab-05ff-455e-9019-227d5582a1b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=854cff2e-98bc-4e61-8bf6-ddc8bdb44f3d,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:54.320889 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57694) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:54.368737 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7a04ce4f-173b-4dec-85ad-0a4780dbf4c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.390554 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7a04ce4f-173b-4dec-85ad-0a4780dbf4c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.436634 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7a04ce4f-173b-4dec-85ad-0a4780dbf4c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.439348 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7a04ce4f-173b-4dec-85ad-0a4780dbf4c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.440651 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-7a04ce4f-173b-4dec-85ad-0a4780dbf4c8 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/854cff2e-98bc-4e61-8bf6-ddc8bdb44f3d HTTP/1.1" status: 204 len: 168 time: 0.1186500 Nov 21 13:58:54.449713 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a04ce4f-173b-4dec-85ad-0a4780dbf4c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=854cff2e-98bc-4e61-8bf6-ddc8bdb44f3d,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:54.717721 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57702) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:54.731095 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-bbb7d24c-d879-4a92-a830-1b3fa6d42030 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.804100 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-bbb7d24c-d879-4a92-a830-1b3fa6d42030 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.807767 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-bbb7d24c-d879-4a92-a830-1b3fa6d42030 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.843276 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbb7d24c-d879-4a92-a830-1b3fa6d42030 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e43a730-6792-45c4-aee4-78012f0335f8,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:54.847475 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-bbb7d24c-d879-4a92-a830-1b3fa6d42030 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=54cffa7a438b4e6e94f80f28bfdaca72&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1281164 Nov 21 13:58:54.850128 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57704) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:54.899486 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7d925798-0df5-45e2-8eda-d16fb12ab293 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.919567 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7d925798-0df5-45e2-8eda-d16fb12ab293 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.964529 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7d925798-0df5-45e2-8eda-d16fb12ab293 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.967072 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7d925798-0df5-45e2-8eda-d16fb12ab293 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:54.968237 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-7d925798-0df5-45e2-8eda-d16fb12ab293 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0e43a730-6792-45c4-aee4-78012f0335f8 HTTP/1.1" status: 204 len: 168 time: 0.1173000 Nov 21 13:58:54.975702 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d925798-0df5-45e2-8eda-d16fb12ab293 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e43a730-6792-45c4-aee4-78012f0335f8,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:56.996914 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57790) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:57.107192 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b057de7d-8f27-4933-8a6d-2e1131dfdb24 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.198994 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b057de7d-8f27-4933-8a6d-2e1131dfdb24 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.204057 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-b057de7d-8f27-4933-8a6d-2e1131dfdb24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.242365 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-b057de7d-8f27-4933-8a6d-2e1131dfdb24 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=5d2c6363017e4481ab8c226c787f72b2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2441170 Nov 21 13:58:57.243498 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b057de7d-8f27-4933-8a6d-2e1131dfdb24 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42ba72ad-76b9-4ca1-98a9-4c12ff4d3169,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:57.244948 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57798) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:57.296616 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-a020cbcb-3c44-4df7-be08-6e7b80138750 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.317628 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-a020cbcb-3c44-4df7-be08-6e7b80138750 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.361867 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-a020cbcb-3c44-4df7-be08-6e7b80138750 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.364556 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-a020cbcb-3c44-4df7-be08-6e7b80138750 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.367928 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-a020cbcb-3c44-4df7-be08-6e7b80138750 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/42ba72ad-76b9-4ca1-98a9-4c12ff4d3169 HTTP/1.1" status: 204 len: 168 time: 0.1191142 Nov 21 13:58:57.374732 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a020cbcb-3c44-4df7-be08-6e7b80138750 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42ba72ad-76b9-4ca1-98a9-4c12ff4d3169,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:57.629024 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57804) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:57.642643 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7410d14d-e8dc-4100-b249-0665870ac947 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.716255 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7410d14d-e8dc-4100-b249-0665870ac947 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.720338 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7410d14d-e8dc-4100-b249-0665870ac947 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.762823 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-7410d14d-e8dc-4100-b249-0665870ac947 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=de99e938425242adb56fc24d6e584e9a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1326818 Nov 21 13:58:57.763698 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7410d14d-e8dc-4100-b249-0665870ac947 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0d8bf7a9-0370-41d8-942f-ca20ae0b0e89,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:57.766075 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57806) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:57.817386 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9e6e8cc6-71af-4a21-8bed-a28db5e80d67 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.841423 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9e6e8cc6-71af-4a21-8bed-a28db5e80d67 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.893693 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9e6e8cc6-71af-4a21-8bed-a28db5e80d67 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.896405 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9e6e8cc6-71af-4a21-8bed-a28db5e80d67 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:57.897548 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-9e6e8cc6-71af-4a21-8bed-a28db5e80d67 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0d8bf7a9-0370-41d8-942f-ca20ae0b0e89 HTTP/1.1" status: 204 len: 168 time: 0.1304603 Nov 21 13:58:57.905378 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e6e8cc6-71af-4a21-8bed-a28db5e80d67 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d8bf7a9-0370-41d8-942f-ca20ae0b0e89,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:58:58.519589 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a14610b-7795-435b-96b8-d469157901d4 req-d35db8ea-ebb3-4651-ae9f-34d9b4fef8e9 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:58:58.521125 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-d35db8ea-ebb3-4651-ae9f-34d9b4fef8e9 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/networks?id=e593a34f-1f09-493d-aafd-a51b70c22643 HTTP/1.1" status: 200 len: 815 time: 0.1064792 Nov 21 13:58:58.536229 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-697c9732-8186-401d-bd68-3a49fd9be8e1 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/quotas/48fbf7b5fd2347789241c7658fd6bb83 HTTP/1.1" status: 200 len: 375 time: 0.0094681 Nov 21 13:58:58.588832 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-851d7051-f288-45b5-96af-e39fd70a9a1f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=48fbf7b5fd2347789241c7658fd6bb83&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0471833 Nov 21 13:58:58.680704 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-e455520d-b3ae-4396-b75a-572dee2623a2 service neutron] 10.222.0.11 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841498 Nov 21 13:58:58.771219 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-2ec8e767-fb8f-4663-a998-10f6f4bda6f0 service neutron] 10.222.0.11 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844066 Nov 21 13:58:58.930691 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b3e93487-2e55-4f00-8cbc-d3e2aed27995 req-a467bf8d-670b-499b-852f-4e2cd2cd2935 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 210 time: 0.0278628 Nov 21 13:58:59.803355 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57904) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:58:59.924833 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f1bb4d8b-4331-482f-a728-9b7274c230dc admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:58:59.998739 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a14610b-7795-435b-96b8-d469157901d4 req-d0b1ed43-dee4-4860-8e38-197948deb755 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:00.004628 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-d0b1ed43-dee4-4860-8e38-197948deb755 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "GET /v2.0/networks?id=e593a34f-1f09-493d-aafd-a51b70c22643 HTTP/1.1" status: 200 len: 815 time: 0.1597478 Nov 21 13:59:00.027861 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5c035ae2-0e1c-48fa-a742-a3c0b8efad45 req-8beab4e8-bec9-48b5-9d72-87abaaff9cb2 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 210 time: 0.0274329 Nov 21 13:59:00.038804 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-8a14610b-7795-435b-96b8-d469157901d4 req-250bcf6e-aa63-468b-b600-cb515880b7e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Request body: {'port': {'device_id': 'b840c92f-e85f-40e9-8099-55cf13c08561', 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643', 'admin_state_up': True, 'tenant_id': '48fbf7b5fd2347789241c7658fd6bb83'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:59:00.084434 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f1bb4d8b-4331-482f-a728-9b7274c230dc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.090020 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f1bb4d8b-4331-482f-a728-9b7274c230dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.147782 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-f1bb4d8b-4331-482f-a728-9b7274c230dc admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=a3cf7f6c931b437bb973d87b1cdb615c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3431804 Nov 21 13:59:00.150544 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57914) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:00.154989 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1bb4d8b-4331-482f-a728-9b7274c230dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=841a63b7-9a55-4b9e-9bef-71cc02f79734,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:00.197264 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8a14610b-7795-435b-96b8-d469157901d4 req-250bcf6e-aa63-468b-b600-cb515880b7e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Made reservation on behalf of 48fbf7b5fd2347789241c7658fd6bb83 for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:59:00.200838 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-8a14610b-7795-435b-96b8-d469157901d4 req-250bcf6e-aa63-468b-b600-cb515880b7e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.207877 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7d34fdd4-364d-4a36-b26e-292a8314ce91 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.210281 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-9dc5bb6f-20fd-46da-a157-4e82659a6eff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.235180 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7d34fdd4-364d-4a36-b26e-292a8314ce91 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.288513 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7d34fdd4-364d-4a36-b26e-292a8314ce91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.291175 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-7d34fdd4-364d-4a36-b26e-292a8314ce91 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.294881 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-7d34fdd4-364d-4a36-b26e-292a8314ce91 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/841a63b7-9a55-4b9e-9bef-71cc02f79734 HTTP/1.1" status: 204 len: 168 time: 0.1406941 Nov 21 13:59:00.300598 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d34fdd4-364d-4a36-b26e-292a8314ce91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=841a63b7-9a55-4b9e-9bef-71cc02f79734,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:00.331634 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-8a14610b-7795-435b-96b8-d469157901d4 req-250bcf6e-aa63-468b-b600-cb515880b7e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Allocated IP 172.20.0.8 (e593a34f-1f09-493d-aafd-a51b70c22643/19a08397-ab57-46f7-b983-e6a3bc005bc2/0a933a52-1c53-4248-b05b-665a5dce9f5a) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:59:00.477299 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-8a14610b-7795-435b-96b8-d469157901d4 req-250bcf6e-aa63-468b-b600-cb515880b7e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.510324 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-8a14610b-7795-435b-96b8-d469157901d4 req-250bcf6e-aa63-468b-b600-cb515880b7e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.522257 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['311b993c-d963-4bbd-9dd2-91f64ff1d918', 'cee3a926-deeb-40c7-8cda-e34f3786308a', '88b1ce6e-bceb-48d2-9c83-267045746fd4'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:59:00.557424 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8a14610b-7795-435b-96b8-d469157901d4 req-250bcf6e-aa63-468b-b600-cb515880b7e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Network e593a34f-1f09-493d-aafd-a51b70c22643 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:59:00.560878 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-8a14610b-7795-435b-96b8-d469157901d4 req-250bcf6e-aa63-468b-b600-cb515880b7e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:59:00.566577 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a14610b-7795-435b-96b8-d469157901d4 req-250bcf6e-aa63-468b-b600-cb515880b7e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:59:00.569989 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 57920) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:00.570713 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-250bcf6e-aa63-468b-b600-cb515880b7e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Pushing event updated for resources: {'Port': ['ID=0a933a52-1c53-4248-b05b-665a5dce9f5a,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:00.587600 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c3d1285d-4361-44a9-828e-b6982e2b9b51 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.621115 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a14610b-7795-435b-96b8-d469157901d4 req-250bcf6e-aa63-468b-b600-cb515880b7e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:00.621851 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-8a14610b-7795-435b-96b8-d469157901d4 req-250bcf6e-aa63-468b-b600-cb515880b7e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.642427 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-250bcf6e-aa63-468b-b600-cb515880b7e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6093950 Nov 21 13:59:00.656000 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Request body: {'port': {'device_id': 'b840c92f-e85f-40e9-8099-55cf13c08561', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:59:00.668473 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c3d1285d-4361-44a9-828e-b6982e2b9b51 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.672802 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c3d1285d-4361-44a9-828e-b6982e2b9b51 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.713762 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-c3d1285d-4361-44a9-828e-b6982e2b9b51 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=5128d72fa1974c0fbb16d337fdac6ea1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1406789 Nov 21 13:59:00.713762 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3d1285d-4361-44a9-828e-b6982e2b9b51 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8bcebd97-4c85-487c-8d33-17d4701124c6,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:00.714096 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.715425 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57922) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:00.811022 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-baaf645e-dfa8-4689-b841-ed8d5749ce4b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:00.892263 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-baaf645e-dfa8-4689-b841-ed8d5749ce4b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:01.002920 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-baaf645e-dfa8-4689-b841-ed8d5749ce4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:01.005413 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-baaf645e-dfa8-4689-b841-ed8d5749ce4b admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:01.006543 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-baaf645e-dfa8-4689-b841-ed8d5749ce4b admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/8bcebd97-4c85-487c-8d33-17d4701124c6 HTTP/1.1" status: 204 len: 168 time: 0.2901783 Nov 21 13:59:01.020918 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baaf645e-dfa8-4689-b841-ed8d5749ce4b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8bcebd97-4c85-487c-8d33-17d4701124c6,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:01.069858 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0a933a52-1c53-4248-b05b-665a5dce9f5a {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:59:01.077847 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:01.091274 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Transition to ACTIVE for port object 0a933a52-1c53-4248-b05b-665a5dce9f5a will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:59:01.097020 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:01.195203 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Pushing event updated for resources: {'Port': ['ID=0a933a52-1c53-4248-b05b-665a5dce9f5a,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:01.228327 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24e3984c-990c-4c3b-b568-933a84c4cb78 req-abdd2971-4cbb-4e9b-9468-f1f7242f31d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:01.229800 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-24e3984c-990c-4c3b-b568-933a84c4cb78 req-abdd2971-4cbb-4e9b-9468-f1f7242f31d4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 943 time: 0.1252007 Nov 21 13:59:01.283852 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Attempting to bind port 0a933a52-1c53-4248-b05b-665a5dce9f5a on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:59:01.283852 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Attempting to bind port 0a933a52-1c53-4248-b05b-665a5dce9f5a by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:59:01.284188 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Attempting to bind port 0a933a52-1c53-4248-b05b-665a5dce9f5a on network e593a34f-1f09-493d-aafd-a51b70c22643 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:59:01.295321 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Port 0a933a52-1c53-4248-b05b-665a5dce9f5a on network e593a34f-1f09-493d-aafd-a51b70c22643 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:59:01.295648 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Attempting to bind port 0a933a52-1c53-4248-b05b-665a5dce9f5a on network e593a34f-1f09-493d-aafd-a51b70c22643 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:59:01.301431 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-24e3984c-990c-4c3b-b568-933a84c4cb78 req-5e8c41da-fd97-44a1-aa6d-add94a95ddd0 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0648587 Nov 21 13:59:01.305335 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 58, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:59:01.305678 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Checking segment: {'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:59:01.306054 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Bound using segment: {'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:59:01.306483 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Bound port: 0a933a52-1c53-4248-b05b-665a5dce9f5a, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '008340fd-3a9e-413b-878e-432ef5e7b038', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:59:01.306843 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:01.370163 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] For port 0a933a52-1c53-4248-b05b-665a5dce9f5a, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:59:01.373696 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] For port 0a933a52-1c53-4248-b05b-665a5dce9f5a, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=0a933a52-1c53-4248-b05b-665a5dce9f5a,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:59:01.378416 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:01.417694 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:01.418313 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:01.419686 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] 10.222.0.50 "PUT /v2.0/ports/0a933a52-1c53-4248-b05b-665a5dce9f5a HTTP/1.1" status: 200 len: 1093 time: 0.7683663 Nov 21 13:59:01.420159 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b840c92f-e85f-40e9-8099-55cf13c08561', 'tag': '0a933a52-1c53-4248-b05b-665a5dce9f5a'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:59:01.422968 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8" -d '{"events": [{"name": "network-changed", "server_uuid": "b840c92f-e85f-40e9-8099-55cf13c08561", "tag": "0a933a52-1c53-4248-b05b-665a5dce9f5a"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:59:01.444477 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70044e63-2a6d-4d81-be6e-bcbb8babe626 service neutron] Pushing event updated for resources: {'Port': ['ID=0a933a52-1c53-4248-b05b-665a5dce9f5a,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:01.490998 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:59:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cea78e7f-3d6a-4458-ade4-c51a39d9fad2 x-openstack-request-id: req-cea78e7f-3d6a-4458-ade4-c51a39d9fad2 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:59:01.491293 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b840c92f-e85f-40e9-8099-55cf13c08561", "tag": "0a933a52-1c53-4248-b05b-665a5dce9f5a", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:59:01.491609 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-cea78e7f-3d6a-4458-ade4-c51a39d9fad2 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:59:01.491957 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b840c92f-e85f-40e9-8099-55cf13c08561', 'tag': '0a933a52-1c53-4248-b05b-665a5dce9f5a', 'status': 'completed', 'code': 200} Nov 21 13:59:01.508134 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a14610b-7795-435b-96b8-d469157901d4 req-e2f36245-f413-42c9-a911-43514b6801ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:01.509516 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-e2f36245-f413-42c9-a911-43514b6801ea service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=48fbf7b5fd2347789241c7658fd6bb83&device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 1096 time: 0.0450110 Nov 21 13:59:01.553818 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-1023e6d8-2462-4b1a-8b88-82bff9cceeca service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0a933a52-1c53-4248-b05b-665a5dce9f5a HTTP/1.1" status: 200 len: 217 time: 0.0336156 Nov 21 13:59:01.610479 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a14610b-7795-435b-96b8-d469157901d4 req-d2166fe1-0847-4c86-a967-12e3e0259e1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:01.612012 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-d2166fe1-0847-4c86-a967-12e3e0259e1c service neutron] 10.222.0.50 "GET /v2.0/subnets?id=19a08397-ab57-46f7-b983-e6a3bc005bc2 HTTP/1.1" status: 200 len: 855 time: 0.0470433 Nov 21 13:59:01.649590 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-05f36632-06a9-451f-b4ff-34a2a36fce1a service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=e593a34f-1f09-493d-aafd-a51b70c22643&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0289316 Nov 21 13:59:01.737640 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-eb1289f8-3dc2-4f19-9cdf-98e69cdd20ec service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800712 Nov 21 13:59:01.832164 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8a14610b-7795-435b-96b8-d469157901d4 req-bf53e451-8e71-40e6-9fe5-a95b4415a431 service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867612 Nov 21 13:59:01.925952 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-9988c7d4-7c28-47f3-b516-ad93c7b12ff3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:01.927484 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-9988c7d4-7c28-47f3-b516-ad93c7b12ff3 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=48fbf7b5fd2347789241c7658fd6bb83&device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 1096 time: 0.0416474 Nov 21 13:59:02.023777 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-8dbff81b-5022-468d-b3d5-43fc862f0e43 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:02.025258 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-8dbff81b-5022-468d-b3d5-43fc862f0e43 service neutron] 10.222.0.50 "GET /v2.0/networks?id=e593a34f-1f09-493d-aafd-a51b70c22643 HTTP/1.1" status: 200 len: 916 time: 0.0871601 Nov 21 13:59:02.071218 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-f773b022-f099-49dd-9d41-7cd5c056cb6e service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0a933a52-1c53-4248-b05b-665a5dce9f5a HTTP/1.1" status: 200 len: 217 time: 0.0378149 Nov 21 13:59:02.125216 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-b75198a6-6c14-4ab6-aeb3-8f9db52be867 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:02.126788 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-b75198a6-6c14-4ab6-aeb3-8f9db52be867 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=19a08397-ab57-46f7-b983-e6a3bc005bc2 HTTP/1.1" status: 200 len: 855 time: 0.0471914 Nov 21 13:59:02.161369 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-5c373a1c-a27a-4e1f-9da7-92b809172434 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=e593a34f-1f09-493d-aafd-a51b70c22643&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0262823 Nov 21 13:59:02.254963 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-f9915e9a-fa09-4a35-b42c-1b75b361f3ae service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845487 Nov 21 13:59:02.350354 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d61da6ff-c7a8-4991-a682-ca9091f9e9b8 req-2c3babc7-9d5e-4523-8b72-17ea2f3e847e service neutron] 10.222.0.50 "GET /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821254 Nov 21 13:59:02.422448 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d766ee8-c03a-4e42-8f50-4921bfef1ae6 req-3b1bcd13-f85b-4739-b5d0-96ce6d3df06f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:02.423898 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6d766ee8-c03a-4e42-8f50-4921bfef1ae6 req-3b1bcd13-f85b-4739-b5d0-96ce6d3df06f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 943 time: 0.0505495 Nov 21 13:59:02.475301 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-6d766ee8-c03a-4e42-8f50-4921bfef1ae6 req-7ee18254-8d6c-47be-8a33-329180391f5a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454154 Nov 21 13:59:02.570671 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-17c20228-090f-426e-92f1-7ba5a5c4fdbe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:03.344619 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 0a933a52-1c53-4248-b05b-665a5dce9f5a details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:59:03.442499 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 0a933a52-1c53-4248-b05b-665a5dce9f5a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=0a933a52-1c53-4248-b05b-665a5dce9f5a,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:59:03.454366 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '0a933a52-1c53-4248-b05b-665a5dce9f5a', 'network_id': 'e593a34f-1f09-493d-aafd-a51b70c22643', 'port_id': '0a933a52-1c53-4248-b05b-665a5dce9f5a', 'mac_address': 'fa:16:3e:48:76:85', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 511, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '19a08397-ab57-46f7-b983-e6a3bc005bc2', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:59:03.490322 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:03.504157 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0a933a52-1c53-4248-b05b-665a5dce9f5a {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:59:03.524643 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 0a933a52-1c53-4248-b05b-665a5dce9f5a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=0a933a52-1c53-4248-b05b-665a5dce9f5a,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:59:03.529209 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:03.579682 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=0a933a52-1c53-4248-b05b-665a5dce9f5a,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:03.586756 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:03.587115 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:03.587452 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:03.587990 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:03.588324 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:03.588655 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:03.588986 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:03.589311 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:03.589634 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:03.589957 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:03.590284 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:03.591207 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:03.609845 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138d1aea-ca43-48db-a0d6-09febca14e60 req-48835217-19b3-4883-8d5e-e135002e06de tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:03.611445 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-138d1aea-ca43-48db-a0d6-09febca14e60 req-48835217-19b3-4883-8d5e-e135002e06de tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 944 time: 0.0625117 Nov 21 13:59:03.663018 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-138d1aea-ca43-48db-a0d6-09febca14e60 req-e3c3c2a8-fdd3-47b6-a1dd-0b06ff613846 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456872 Nov 21 13:59:03.795787 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['0a933a52-1c53-4248-b05b-665a5dce9f5a'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:59:03.900750 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:04.776948 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9281b06-3215-4cfe-9ae8-4f68027f3e69 req-9ed1bce1-db7e-4e13-b0bc-0a774ff7a563 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:04.778412 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e9281b06-3215-4cfe-9ae8-4f68027f3e69 req-9ed1bce1-db7e-4e13-b0bc-0a774ff7a563 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 944 time: 0.0491812 Nov 21 13:59:04.824607 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e9281b06-3215-4cfe-9ae8-4f68027f3e69 req-5464e12c-8de7-4114-873c-e4f05e833c22 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403726 Nov 21 13:59:05.002642 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 57998) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:05.074598 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:05.105143 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a3850e83-5107-4e71-aa74-ea125f3d5394 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:05.177960 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a3850e83-5107-4e71-aa74-ea125f3d5394 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:05.181301 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-a3850e83-5107-4e71-aa74-ea125f3d5394 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:05.217534 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-a3850e83-5107-4e71-aa74-ea125f3d5394 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7f24f60fa8be4a6ca97a7f6740a0e22a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2137909 Nov 21 13:59:05.220051 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3850e83-5107-4e71-aa74-ea125f3d5394 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5dbc115-100e-419b-9d37-e88a0ce9a01c,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:05.220860 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 58002) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:05.270955 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-360d16db-f6ee-4ca1-a01c-4e85f0a1939e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:05.292635 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-360d16db-f6ee-4ca1-a01c-4e85f0a1939e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:05.337110 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-360d16db-f6ee-4ca1-a01c-4e85f0a1939e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:05.339776 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-360d16db-f6ee-4ca1-a01c-4e85f0a1939e admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:05.340949 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-360d16db-f6ee-4ca1-a01c-4e85f0a1939e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/e5dbc115-100e-419b-9d37-e88a0ce9a01c HTTP/1.1" status: 204 len: 168 time: 0.1191096 Nov 21 13:59:05.348360 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-360d16db-f6ee-4ca1-a01c-4e85f0a1939e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5dbc115-100e-419b-9d37-e88a0ce9a01c,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:05.365547 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 0a933a52-1c53-4248-b05b-665a5dce9f5a up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:59:05.414992 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port 0a933a52-1c53-4248-b05b-665a5dce9f5a completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:59:05.418619 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 0a933a52-1c53-4248-b05b-665a5dce9f5a triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:59:05.418985 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:05.497812 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:05.522386 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b840c92f-e85f-40e9-8099-55cf13c08561', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0a933a52-1c53-4248-b05b-665a5dce9f5a'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:59:05.524921 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00a82e5b-b59d-4b1d-866e-a22ab62a97b5" -d '{"events": [{"server_uuid": "b840c92f-e85f-40e9-8099-55cf13c08561", "name": "network-vif-plugged", "status": "completed", "tag": "0a933a52-1c53-4248-b05b-665a5dce9f5a"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:59:05.541751 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 0a933a52-1c53-4248-b05b-665a5dce9f5a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=0a933a52-1c53-4248-b05b-665a5dce9f5a,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:59:05.546187 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:05.570186 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:59:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d26886d-4601-4158-941b-de3f4221d2fd x-openstack-request-id: req-9d26886d-4601-4158-941b-de3f4221d2fd {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:59:05.570412 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b840c92f-e85f-40e9-8099-55cf13c08561", "name": "network-vif-plugged", "status": "completed", "tag": "0a933a52-1c53-4248-b05b-665a5dce9f5a", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:59:05.570670 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-9d26886d-4601-4158-941b-de3f4221d2fd {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:59:05.571058 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b840c92f-e85f-40e9-8099-55cf13c08561', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0a933a52-1c53-4248-b05b-665a5dce9f5a', 'code': 200} Nov 21 13:59:05.598790 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=0a933a52-1c53-4248-b05b-665a5dce9f5a,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:05.757727 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d3e126-dc5a-47f0-8132-b76f1c768f82 req-6b690bbf-0e5b-40b2-a86a-d44224449dcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:05.759364 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-62d3e126-dc5a-47f0-8132-b76f1c768f82 req-6b690bbf-0e5b-40b2-a86a-d44224449dcc service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 1098 time: 0.0426178 Nov 21 13:59:05.804119 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-62d3e126-dc5a-47f0-8132-b76f1c768f82 req-f4957ba2-bc7e-4f3a-8473-ad21df6c5a6c service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372689 Nov 21 13:59:05.861315 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:05.943984 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7557efaa-4d98-479e-bee1-1a053cd4e0c3 req-3c2a7519-ed5f-4028-b09a-e9fa886a804e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:05.945485 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7557efaa-4d98-479e-bee1-1a053cd4e0c3 req-3c2a7519-ed5f-4028-b09a-e9fa886a804e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 945 time: 0.0481014 Nov 21 13:59:05.976089 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 58028) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:05.993678 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7557efaa-4d98-479e-bee1-1a053cd4e0c3 req-31e71c9c-bfa4-46ae-b741-897998fc8d4c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422432 Nov 21 13:59:06.069627 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1408921012-network', 'tenant_id': 'b0b942babf814a7ead64e37a8ded8dff'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:59:06.089953 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Made reservation on behalf of b0b942babf814a7ead64e37a8ded8dff for: {'network': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:59:06.092218 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:06.100995 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:06.173337 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:06.176802 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:06.197137 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] vlan segment allocate from pool success with {'vlan_id': 518, 'physical_network': 'physnet1'} {{(pid=109040) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:59:06.211574 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=53f38c3c-a247-4c77-811f-105c385af4c8,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:06.214559 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:06.214974 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.segments_db [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Added segment c0b739a0-f430-4270-99e1-1c9b5f72d8a8 of type vlan for network 6f097009-41cb-4ff1-a076-87e9a8cd07fe Nov 21 13:59:06.254224 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:06.281586 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:06.282529 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:06.283143 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:06.331564 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3543875 Nov 21 13:59:06.334572 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 58032) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:06.339440 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-8755b655-3a74-44de-9a89-83feb72f17e5 admin admin] Request body: {'subnet': {'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1408921012-subnet', 'tenant_id': 'b0b942babf814a7ead64e37a8ded8dff', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:59:06.344134 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc4de93f-6b04-43be-99f4-45b454a47861 admin admin] Pushing event updated for resources: {'Network': ['ID=6f097009-41cb-4ff1-a076-87e9a8cd07fe,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:06.353817 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 6f097009-41cb-4ff1-a076-87e9a8cd07fe details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:59:06.360537 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8755b655-3a74-44de-9a89-83feb72f17e5 admin admin] Made reservation on behalf of b0b942babf814a7ead64e37a8ded8dff for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:59:06.362876 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8755b655-3a74-44de-9a89-83feb72f17e5 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-261005224'] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:06.531840 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8755b655-3a74-44de-9a89-83feb72f17e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3086915', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-261005206'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:06.589471 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8755b655-3a74-44de-9a89-83feb72f17e5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8637d89e-69c8-4f6e-a47d-881de8195666,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:06.598017 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8755b655-3a74-44de-9a89-83feb72f17e5 admin admin] Checking segment: {'id': 'c0b739a0-f430-4270-99e1-1c9b5f72d8a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:59:06.598358 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8755b655-3a74-44de-9a89-83feb72f17e5 admin admin] Network hostable DHCP agents. Network: 6f097009-41cb-4ff1-a076-87e9a8cd07fe, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:59:06.614358 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8755b655-3a74-44de-9a89-83feb72f17e5 admin admin] Network 6f097009-41cb-4ff1-a076-87e9a8cd07fe is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:59:06.623585 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-8755b655-3a74-44de-9a89-83feb72f17e5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 6f097009-41cb-4ff1-a076-87e9a8cd07fe) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:59:06.627968 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8755b655-3a74-44de-9a89-83feb72f17e5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:06.628553 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-8755b655-3a74-44de-9a89-83feb72f17e5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:06.633418 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ee44102-bc8f-4c6f-9e5f-b984dbbee082 None None] Network 6f097009-41cb-4ff1-a076-87e9a8cd07fe requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:59:06.644340 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-8755b655-3a74-44de-9a89-83feb72f17e5 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3086867 Nov 21 13:59:06.757506 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa627e16-2fe0-404c-b372-bc746c046097 None None] Network 6f097009-41cb-4ff1-a076-87e9a8cd07fe requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:59:07.126753 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b98aea6e-7c24-4225-a07f-2667cbe7f1e2 req-5da1ddd9-de51-4ef8-97cc-148e3faafecd tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:07.132301 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b98aea6e-7c24-4225-a07f-2667cbe7f1e2 req-5da1ddd9-de51-4ef8-97cc-148e3faafecd tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 945 time: 0.0632648 Nov 21 13:59:07.178163 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b98aea6e-7c24-4225-a07f-2667cbe7f1e2 req-85166b0e-c2d6-4a5a-b700-b3465f6fc174 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423255 Nov 21 13:59:07.611792 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:59:08.294184 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f202b9dd-899f-4a57-99fc-a7f98c36993c req-4fdf0881-0e24-4d13-bc58-43e9a100772c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:08.295697 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f202b9dd-899f-4a57-99fc-a7f98c36993c req-4fdf0881-0e24-4d13-bc58-43e9a100772c tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 945 time: 0.0511339 Nov 21 13:59:08.341666 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f202b9dd-899f-4a57-99fc-a7f98c36993c req-a4ba3e97-e02f-4528-bcbf-6a34b4040e96 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400834 Nov 21 13:59:08.369624 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-ba5f2a66-624c-41f7-b180-b1f2f34bdbe7 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:08.371137 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-ba5f2a66-624c-41f7-b180-b1f2f34bdbe7 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/networks?id=6f097009-41cb-4ff1-a076-87e9a8cd07fe HTTP/1.1" status: 200 len: 814 time: 0.1044281 Nov 21 13:59:08.387870 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-75a61995-36fe-4a90-b5ef-ad6ab7c00ab7 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/quotas/b0b942babf814a7ead64e37a8ded8dff HTTP/1.1" status: 200 len: 375 time: 0.0090747 Nov 21 13:59:08.419110 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-9999670a-c8e6-4975-80b2-c72bc885d257 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=b0b942babf814a7ead64e37a8ded8dff&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0252132 Nov 21 13:59:08.514166 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-219ccd3d-dbdb-4e44-961c-6d1e5cb62fb3 service neutron] 10.222.0.11 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880473 Nov 21 13:59:08.608644 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-0bd3ef03-7ebc-4244-80df-dfc84eaace78 service neutron] 10.222.0.11 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0878894 Nov 21 13:59:08.771062 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a2305b18-ab3c-4a7d-8332-fa4583b90196 req-c545b5c8-969e-4c06-934b-8a1bf99b0347 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 210 time: 0.0279040 Nov 21 13:59:09.980348 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-59ce9d08-6e01-4241-b737-2af7f9010d46 req-0e6b28b1-1aa8-4d6c-ae40-1ca407d04451 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 210 time: 0.0348256 Nov 21 13:59:10.038047 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-d28a0bd2-bc33-4e94-847b-fe31d92a89ae tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:10.039461 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-d28a0bd2-bc33-4e94-847b-fe31d92a89ae tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.50 "GET /v2.0/networks?id=6f097009-41cb-4ff1-a076-87e9a8cd07fe HTTP/1.1" status: 200 len: 814 time: 0.4272943 Nov 21 13:59:10.063078 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-f210a2a8-0c65-40ff-a55a-2e853ab8b283 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Request body: {'port': {'device_id': '7fdb301a-82fc-4b66-93ed-988cb00b0a58', 'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe', 'admin_state_up': True, 'tenant_id': 'b0b942babf814a7ead64e37a8ded8dff'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:59:10.169456 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-f210a2a8-0c65-40ff-a55a-2e853ab8b283 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Made reservation on behalf of b0b942babf814a7ead64e37a8ded8dff for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:59:10.172965 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-f210a2a8-0c65-40ff-a55a-2e853ab8b283 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:10.294088 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-f210a2a8-0c65-40ff-a55a-2e853ab8b283 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Allocated IP 172.20.0.7 (6f097009-41cb-4ff1-a076-87e9a8cd07fe/8637d89e-69c8-4f6e-a47d-881de8195666/8025d2bd-f151-4446-9381-c3834109dabf) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 13:59:10.442530 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-f210a2a8-0c65-40ff-a55a-2e853ab8b283 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:10.474398 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-f210a2a8-0c65-40ff-a55a-2e853ab8b283 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:10.516508 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-f210a2a8-0c65-40ff-a55a-2e853ab8b283 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Network 6f097009-41cb-4ff1-a076-87e9a8cd07fe is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 13:59:10.519584 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-f210a2a8-0c65-40ff-a55a-2e853ab8b283 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:59:10.523009 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-f210a2a8-0c65-40ff-a55a-2e853ab8b283 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 13:59:10.529011 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f210a2a8-0c65-40ff-a55a-2e853ab8b283 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Pushing event updated for resources: {'Port': ['ID=8025d2bd-f151-4446-9381-c3834109dabf,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:10.576122 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-f210a2a8-0c65-40ff-a55a-2e853ab8b283 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:10.576747 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-f210a2a8-0c65-40ff-a55a-2e853ab8b283 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:10.591641 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-f210a2a8-0c65-40ff-a55a-2e853ab8b283 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5322964 Nov 21 13:59:10.605874 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Request body: {'port': {'device_id': '7fdb301a-82fc-4b66-93ed-988cb00b0a58', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:59:10.656029 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:10.907751 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8025d2bd-f151-4446-9381-c3834109dabf {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:59:10.914854 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:10.926132 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Transition to ACTIVE for port object 8025d2bd-f151-4446-9381-c3834109dabf will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 13:59:10.929584 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:10.979349 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Pushing event updated for resources: {'Port': ['ID=8025d2bd-f151-4446-9381-c3834109dabf,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:11.050284 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Attempting to bind port 8025d2bd-f151-4446-9381-c3834109dabf on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 13:59:11.050871 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Attempting to bind port 8025d2bd-f151-4446-9381-c3834109dabf by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': 'c0b739a0-f430-4270-99e1-1c9b5f72d8a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 13:59:11.050970 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Attempting to bind port 8025d2bd-f151-4446-9381-c3834109dabf on network 6f097009-41cb-4ff1-a076-87e9a8cd07fe {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:59:11.055485 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Port 8025d2bd-f151-4446-9381-c3834109dabf on network 6f097009-41cb-4ff1-a076-87e9a8cd07fe not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 13:59:11.055832 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Attempting to bind port 8025d2bd-f151-4446-9381-c3834109dabf on network 6f097009-41cb-4ff1-a076-87e9a8cd07fe {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 13:59:11.060724 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 58, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 13:59:11.061059 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Checking segment: {'id': 'c0b739a0-f430-4270-99e1-1c9b5f72d8a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:59:11.061442 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Bound using segment: {'id': 'c0b739a0-f430-4270-99e1-1c9b5f72d8a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 13:59:11.061878 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Bound port: 8025d2bd-f151-4446-9381-c3834109dabf, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c0b739a0-f430-4270-99e1-1c9b5f72d8a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 13:59:11.062818 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:11.104518 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb450b2f-9e00-4dda-b4e6-872d6dd26e30 req-0b29ed01-8cb1-4dec-95a5-f2a48a055e2b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:11.105991 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-bb450b2f-9e00-4dda-b4e6-872d6dd26e30 req-0b29ed01-8cb1-4dec-95a5-f2a48a055e2b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 943 time: 0.0536478 Nov 21 13:59:11.126495 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] For port 8025d2bd-f151-4446-9381-c3834109dabf, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 13:59:11.129487 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] For port 8025d2bd-f151-4446-9381-c3834109dabf, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8025d2bd-f151-4446-9381-c3834109dabf,segment=NetworkSegment(c0b739a0-f430-4270-99e1-1c9b5f72d8a8),segment_id=c0b739a0-f430-4270-99e1-1c9b5f72d8a8)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 13:59:11.135091 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:11.155332 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-bb450b2f-9e00-4dda-b4e6-872d6dd26e30 req-56d843b1-af48-41ab-8049-ed4991d67b65 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421157 Nov 21 13:59:11.176167 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:11.176167 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:11.176167 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] 10.222.0.50 "PUT /v2.0/ports/8025d2bd-f151-4446-9381-c3834109dabf HTTP/1.1" status: 200 len: 1093 time: 0.5741096 Nov 21 13:59:11.176483 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7fdb301a-82fc-4b66-93ed-988cb00b0a58', 'tag': '8025d2bd-f151-4446-9381-c3834109dabf'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:59:11.178720 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d" -d '{"events": [{"name": "network-changed", "server_uuid": "7fdb301a-82fc-4b66-93ed-988cb00b0a58", "tag": "8025d2bd-f151-4446-9381-c3834109dabf"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:59:11.201372 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Pushing event updated for resources: {'Port': ['ID=8025d2bd-f151-4446-9381-c3834109dabf,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:11.209388 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:11.209737 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:11.210088 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:11.210428 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:11.210766 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:11.211104 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:11.211436 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:11.211768 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:11.212864 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:11.212864 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:11.212864 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:11.213165 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-605a45b9-42c0-4bdd-b9fd-d272641a6b26 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:11.233103 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 13:59:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd9a5eba-3e5f-4a17-9502-5e20f7b77226 x-openstack-request-id: req-bd9a5eba-3e5f-4a17-9502-5e20f7b77226 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:59:11.233389 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7fdb301a-82fc-4b66-93ed-988cb00b0a58", "tag": "8025d2bd-f151-4446-9381-c3834109dabf", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:59:11.233670 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-bd9a5eba-3e5f-4a17-9502-5e20f7b77226 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:59:11.234090 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7fdb301a-82fc-4b66-93ed-988cb00b0a58', 'tag': '8025d2bd-f151-4446-9381-c3834109dabf', 'status': 'completed', 'code': 200} Nov 21 13:59:11.265520 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-db0f827a-323e-4fa5-8411-602e7347d2fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:11.266991 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-db0f827a-323e-4fa5-8411-602e7347d2fc service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=b0b942babf814a7ead64e37a8ded8dff&device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 1096 time: 0.0424824 Nov 21 13:59:11.311711 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-24b81db9-0cc0-4903-9220-d70830d626b9 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8025d2bd-f151-4446-9381-c3834109dabf HTTP/1.1" status: 200 len: 217 time: 0.0336137 Nov 21 13:59:11.369193 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-305f80ea-986e-422d-8359-da28273c8f99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:11.370631 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-305f80ea-986e-422d-8359-da28273c8f99 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8637d89e-69c8-4f6e-a47d-881de8195666 HTTP/1.1" status: 200 len: 854 time: 0.0478342 Nov 21 13:59:11.402538 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-6e633ef0-31d2-4ee8-85c1-0c846038fe6c service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=6f097009-41cb-4ff1-a076-87e9a8cd07fe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0238431 Nov 21 13:59:11.491690 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-bf7ac7e7-724f-4898-923d-3dab0061c160 service neutron] 10.222.0.50 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0784526 Nov 21 13:59:11.583109 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-be71c794-92f7-45c6-ac27-8f0255b0a0fc req-a650b936-cbc9-40e5-9fe8-5d5a52e12159 service neutron] 10.222.0.50 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822124 Nov 21 13:59:11.665872 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-7fd008bb-cd8a-4c81-bc08-52bb9a68eba0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:11.667292 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-7fd008bb-cd8a-4c81-bc08-52bb9a68eba0 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=b0b942babf814a7ead64e37a8ded8dff&device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 1096 time: 0.0397763 Nov 21 13:59:11.763187 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-f66daf30-ff98-4f00-a33a-cfa757527e0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:11.764584 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-f66daf30-ff98-4f00-a33a-cfa757527e0b service neutron] 10.222.0.50 "GET /v2.0/networks?id=6f097009-41cb-4ff1-a076-87e9a8cd07fe HTTP/1.1" status: 200 len: 915 time: 0.0872765 Nov 21 13:59:11.806174 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-59f16d26-7db3-48dc-a25f-1f050d510107 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8025d2bd-f151-4446-9381-c3834109dabf HTTP/1.1" status: 200 len: 217 time: 0.0331595 Nov 21 13:59:11.855619 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-3146acfd-8249-468b-8fd4-99bdb490b530 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:11.857081 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-3146acfd-8249-468b-8fd4-99bdb490b530 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8637d89e-69c8-4f6e-a47d-881de8195666 HTTP/1.1" status: 200 len: 854 time: 0.0427153 Nov 21 13:59:11.891124 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-eec54605-2b7d-41bd-874a-a4dadf793e36 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=6f097009-41cb-4ff1-a076-87e9a8cd07fe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0253847 Nov 21 13:59:11.984373 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-36fa47d4-ecfc-4452-bea9-a54dff198368 service neutron] 10.222.0.50 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819874 Nov 21 13:59:12.077175 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3a5f8c9b-f370-4adf-a2ca-6b0586a2393d req-bfb715d6-8fc2-4023-bc9c-12c0466bd22e service neutron] 10.222.0.50 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845981 Nov 21 13:59:12.272374 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4fe9244-d641-478d-93b4-099e7cf54dbd req-881015cf-0d8a-4744-b6ee-d0fee1c0488a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:12.273887 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f4fe9244-d641-478d-93b4-099e7cf54dbd req-881015cf-0d8a-4744-b6ee-d0fee1c0488a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 943 time: 0.0500581 Nov 21 13:59:12.323069 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f4fe9244-d641-478d-93b4-099e7cf54dbd req-aa7fb618-1aaf-4751-8f2c-576af45f3e80 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429697 Nov 21 13:59:13.436545 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 8025d2bd-f151-4446-9381-c3834109dabf details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 13:59:13.437702 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1de3f84d-0c50-4d63-84d6-51723d20a946 req-b4f2acf5-1b5a-4fc7-bdeb-98c4a0cc806d tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:13.439182 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1de3f84d-0c50-4d63-84d6-51723d20a946 req-b4f2acf5-1b5a-4fc7-bdeb-98c4a0cc806d tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 943 time: 0.0488627 Nov 21 13:59:13.486040 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1de3f84d-0c50-4d63-84d6-51723d20a946 req-97191400-832b-4e8c-b920-15216b4246e1 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409384 Nov 21 13:59:13.527997 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 8025d2bd-f151-4446-9381-c3834109dabf, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8025d2bd-f151-4446-9381-c3834109dabf,segment=NetworkSegment(c0b739a0-f430-4270-99e1-1c9b5f72d8a8),segment_id=c0b739a0-f430-4270-99e1-1c9b5f72d8a8)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:59:13.539478 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '8025d2bd-f151-4446-9381-c3834109dabf', 'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe', 'port_id': '8025d2bd-f151-4446-9381-c3834109dabf', 'mac_address': 'fa:16:3e:91:fb:1d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 518, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8637d89e-69c8-4f6e-a47d-881de8195666', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 13:59:13.573893 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:13.589484 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8025d2bd-f151-4446-9381-c3834109dabf {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 13:59:13.608081 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 8025d2bd-f151-4446-9381-c3834109dabf, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8025d2bd-f151-4446-9381-c3834109dabf,segment=NetworkSegment(c0b739a0-f430-4270-99e1-1c9b5f72d8a8),segment_id=c0b739a0-f430-4270-99e1-1c9b5f72d8a8)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:59:13.612382 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:13.661916 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=8025d2bd-f151-4446-9381-c3834109dabf,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:13.899568 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['8025d2bd-f151-4446-9381-c3834109dabf'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:59:14.598636 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56cf1e8c-f00d-473c-9abb-ccdbe9675a5d req-140cc8b1-0086-4863-8e58-6fd2898ded0b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:14.600123 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-56cf1e8c-f00d-473c-9abb-ccdbe9675a5d req-140cc8b1-0086-4863-8e58-6fd2898ded0b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 944 time: 0.0479882 Nov 21 13:59:14.649244 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-56cf1e8c-f00d-473c-9abb-ccdbe9675a5d req-086df05c-1546-4e37-a95d-a6ec6ae3c83b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433922 Nov 21 13:59:15.464687 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 8025d2bd-f151-4446-9381-c3834109dabf up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 13:59:15.512800 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port 8025d2bd-f151-4446-9381-c3834109dabf completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 13:59:15.516999 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 8025d2bd-f151-4446-9381-c3834109dabf triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 13:59:15.517376 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:15.597941 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:15.620725 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7fdb301a-82fc-4b66-93ed-988cb00b0a58', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8025d2bd-f151-4446-9381-c3834109dabf'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:59:15.622947 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d827fded-9516-46d4-97e7-eb6fe94253c6" -d '{"events": [{"server_uuid": "7fdb301a-82fc-4b66-93ed-988cb00b0a58", "name": "network-vif-plugged", "status": "completed", "tag": "8025d2bd-f151-4446-9381-c3834109dabf"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:59:15.641492 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 8025d2bd-f151-4446-9381-c3834109dabf, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8025d2bd-f151-4446-9381-c3834109dabf,segment=NetworkSegment(c0b739a0-f430-4270-99e1-1c9b5f72d8a8),segment_id=c0b739a0-f430-4270-99e1-1c9b5f72d8a8)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:59:15.645393 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:15.668430 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:59:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ae03109-0fc1-4a79-8723-7f5c78d00fd1 x-openstack-request-id: req-0ae03109-0fc1-4a79-8723-7f5c78d00fd1 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:59:15.668722 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7fdb301a-82fc-4b66-93ed-988cb00b0a58", "name": "network-vif-plugged", "status": "completed", "tag": "8025d2bd-f151-4446-9381-c3834109dabf", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:59:15.668971 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-0ae03109-0fc1-4a79-8723-7f5c78d00fd1 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:59:15.669355 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7fdb301a-82fc-4b66-93ed-988cb00b0a58', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8025d2bd-f151-4446-9381-c3834109dabf', 'code': 200} Nov 21 13:59:15.698030 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=8025d2bd-f151-4446-9381-c3834109dabf,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:15.767258 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe91c7b-5ca4-45e7-98b0-a1c914f6977a req-e3762cbc-f2cb-4b3c-b870-7e5da964b8c4 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:15.768768 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0fe91c7b-5ca4-45e7-98b0-a1c914f6977a req-e3762cbc-f2cb-4b3c-b870-7e5da964b8c4 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 945 time: 0.0495143 Nov 21 13:59:15.816806 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0fe91c7b-5ca4-45e7-98b0-a1c914f6977a req-256999e6-3e08-416a-bfcc-b46a46717d94 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420444 Nov 21 13:59:15.844219 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8f9e417-7478-449a-a6e5-9a70131b2072 req-a75f5c81-b25f-42df-9ac6-2e9d7e5d1ce8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:15.845909 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a8f9e417-7478-449a-a6e5-9a70131b2072 req-a75f5c81-b25f-42df-9ac6-2e9d7e5d1ce8 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 1098 time: 0.0441861 Nov 21 13:59:15.899817 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a8f9e417-7478-449a-a6e5-9a70131b2072 req-5ce2e35f-c27b-40dc-acd4-1a33171eb595 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443752 Nov 21 13:59:16.939053 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cc20d2-1e84-4edc-9565-f84814303945 req-10bfcfa1-1c5c-4d43-a763-110543833953 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:16.940525 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c2cc20d2-1e84-4edc-9565-f84814303945 req-10bfcfa1-1c5c-4d43-a763-110543833953 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 945 time: 0.0512912 Nov 21 13:59:16.986494 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c2cc20d2-1e84-4edc-9565-f84814303945 req-a2ca727d-dc69-43d7-be72-d2f396be1adf tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401251 Nov 21 13:59:18.098392 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b3226d-8673-43d2-af0f-f31dfa553358 req-c12f528b-c95d-44d2-b4cd-8208315d6630 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:18.099863 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c7b3226d-8673-43d2-af0f-f31dfa553358 req-c12f528b-c95d-44d2-b4cd-8208315d6630 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 945 time: 0.0471976 Nov 21 13:59:18.145971 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c7b3226d-8673-43d2-af0f-f31dfa553358 req-d53fa427-faf5-4b7d-9139-2857c25a44d9 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402691 Nov 21 13:59:20.150869 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36e50789-a03f-4c17-8301-b1469701043a req-e879d0ba-6c63-4d94-89ce-1c35f0502791 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:20.152462 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-36e50789-a03f-4c17-8301-b1469701043a req-e879d0ba-6c63-4d94-89ce-1c35f0502791 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 945 time: 0.0493951 Nov 21 13:59:20.200255 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-36e50789-a03f-4c17-8301-b1469701043a req-a7fd7f3a-8491-4770-a824-95d635c5294d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417042 Nov 21 13:59:21.318954 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e2cf3b-36f4-4fc9-8392-b21136bb82ae req-424f8d37-914f-40aa-ae2f-233c7772a44a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:21.320444 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-46e2cf3b-36f4-4fc9-8392-b21136bb82ae req-424f8d37-914f-40aa-ae2f-233c7772a44a tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 945 time: 0.0524027 Nov 21 13:59:21.367974 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-46e2cf3b-36f4-4fc9-8392-b21136bb82ae req-371a3edd-2f39-4ea9-9376-d970fd4ad288 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415661 Nov 21 13:59:21.908600 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-360c22b7-d53a-4726-be13-18fcfb48afa4 req-2d1dc3a6-4319-4dd8-9697-5428b94a6677 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:21.910672 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-360c22b7-d53a-4726-be13-18fcfb48afa4 req-2d1dc3a6-4319-4dd8-9697-5428b94a6677 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 945 time: 0.0522363 Nov 21 13:59:22.005393 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-360c22b7-d53a-4726-be13-18fcfb48afa4 req-47eecc52-6aaa-40bc-8c07-4aa4feda008b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Deleting port 0a933a52-1c53-4248-b05b-665a5dce9f5a {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:59:22.005732 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-360c22b7-d53a-4726-be13-18fcfb48afa4 req-47eecc52-6aaa-40bc-8c07-4aa4feda008b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:22.094126 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-360c22b7-d53a-4726-be13-18fcfb48afa4 req-47eecc52-6aaa-40bc-8c07-4aa4feda008b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] For port 0a933a52-1c53-4248-b05b-665a5dce9f5a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=0a933a52-1c53-4248-b05b-665a5dce9f5a,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:59:22.094491 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-360c22b7-d53a-4726-be13-18fcfb48afa4 req-47eecc52-6aaa-40bc-8c07-4aa4feda008b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:22.111743 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-360c22b7-d53a-4726-be13-18fcfb48afa4 req-47eecc52-6aaa-40bc-8c07-4aa4feda008b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling delete_port for 0a933a52-1c53-4248-b05b-665a5dce9f5a owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:59:22.249290 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-360c22b7-d53a-4726-be13-18fcfb48afa4 req-47eecc52-6aaa-40bc-8c07-4aa4feda008b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:22.261740 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['311b993c-d963-4bbd-9dd2-91f64ff1d918', 'cee3a926-deeb-40c7-8cda-e34f3786308a', '88b1ce6e-bceb-48d2-9c83-267045746fd4', '0a933a52-1c53-4248-b05b-665a5dce9f5a'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:59:22.279421 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47eecc52-6aaa-40bc-8c07-4aa4feda008b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Pushing event deleted for resources: {'Port': ['ID=0a933a52-1c53-4248-b05b-665a5dce9f5a,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:22.324375 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-360c22b7-d53a-4726-be13-18fcfb48afa4 req-47eecc52-6aaa-40bc-8c07-4aa4feda008b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] No DVR routers for this DVR port 0a933a52-1c53-4248-b05b-665a5dce9f5a on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:59:22.326887 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-360c22b7-d53a-4726-be13-18fcfb48afa4 req-47eecc52-6aaa-40bc-8c07-4aa4feda008b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:22.330301 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-360c22b7-d53a-4726-be13-18fcfb48afa4 req-47eecc52-6aaa-40bc-8c07-4aa4feda008b tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "DELETE /v2.0/ports/0a933a52-1c53-4248-b05b-665a5dce9f5a HTTP/1.1" status: 204 len: 173 time: 0.4128621 Nov 21 13:59:22.330729 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b840c92f-e85f-40e9-8099-55cf13c08561', 'name': 'network-vif-deleted', 'tag': '0a933a52-1c53-4248-b05b-665a5dce9f5a'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:59:22.332977 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-27f96070-4296-4071-92f7-63ad58cdb103" -d '{"events": [{"server_uuid": "b840c92f-e85f-40e9-8099-55cf13c08561", "name": "network-vif-deleted", "tag": "0a933a52-1c53-4248-b05b-665a5dce9f5a"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:59:22.382331 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:59:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81c0575a-93a8-46f8-bff5-e33901908fa6 x-openstack-request-id: req-81c0575a-93a8-46f8-bff5-e33901908fa6 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:59:22.382626 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b840c92f-e85f-40e9-8099-55cf13c08561", "name": "network-vif-deleted", "tag": "0a933a52-1c53-4248-b05b-665a5dce9f5a", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:59:22.382931 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-81c0575a-93a8-46f8-bff5-e33901908fa6 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:59:22.383334 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b840c92f-e85f-40e9-8099-55cf13c08561', 'name': 'network-vif-deleted', 'tag': '0a933a52-1c53-4248-b05b-665a5dce9f5a', 'status': 'completed', 'code': 200} Nov 21 13:59:22.478466 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-120f59a8-d69d-4904-be04-611e94b1a96b req-c9450aa6-0cfd-4ac7-9688-b83f357a75e3 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=b840c92f-e85f-40e9-8099-55cf13c08561 HTTP/1.1" status: 200 len: 210 time: 0.0264857 Nov 21 13:59:22.606153 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:25.015119 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cbe1aeb-4499-46ce-aa6a-6b7e23b908d0 req-6b9c09bd-dfa6-471a-83b8-4071113bf03d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:25.016598 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3cbe1aeb-4499-46ce-aa6a-6b7e23b908d0 req-6b9c09bd-dfa6-471a-83b8-4071113bf03d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 945 time: 0.0481958 Nov 21 13:59:25.066495 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3cbe1aeb-4499-46ce-aa6a-6b7e23b908d0 req-6945ec40-83a7-48c9-893e-932cbb26ee23 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433733 Nov 21 13:59:25.499626 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 0a933a52-1c53-4248-b05b-665a5dce9f5a no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:59:25.520549 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: 0a933a52-1c53-4248-b05b-665a5dce9f5a {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:59:25.520890 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 0a933a52-1c53-4248-b05b-665a5dce9f5a not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:59:26.181288 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecce002f-afab-45fd-bda4-94698fda2490 req-f38fcd24-7f14-40b5-b599-a65d2848e61f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:26.182731 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ecce002f-afab-45fd-bda4-94698fda2490 req-f38fcd24-7f14-40b5-b599-a65d2848e61f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 945 time: 0.0487056 Nov 21 13:59:26.230088 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ecce002f-afab-45fd-bda4-94698fda2490 req-0115bded-881f-44f3-8282-e02d36b845ea tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413389 Nov 21 13:59:26.730787 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5afbf431-07eb-47fb-a208-b95fc65232a7 req-473bc619-9d9e-4fea-9734-1f6bf344a661 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:26.732161 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5afbf431-07eb-47fb-a208-b95fc65232a7 req-473bc619-9d9e-4fea-9734-1f6bf344a661 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 945 time: 0.0478568 Nov 21 13:59:26.823394 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-5afbf431-07eb-47fb-a208-b95fc65232a7 req-525d01b5-410f-4668-83ff-2482d186b802 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Deleting port 88b1ce6e-bceb-48d2-9c83-267045746fd4 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:59:26.823728 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-5afbf431-07eb-47fb-a208-b95fc65232a7 req-525d01b5-410f-4668-83ff-2482d186b802 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:26.916538 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-5afbf431-07eb-47fb-a208-b95fc65232a7 req-525d01b5-410f-4668-83ff-2482d186b802 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] For port 88b1ce6e-bceb-48d2-9c83-267045746fd4, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=88b1ce6e-bceb-48d2-9c83-267045746fd4,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:59:26.917200 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-5afbf431-07eb-47fb-a208-b95fc65232a7 req-525d01b5-410f-4668-83ff-2482d186b802 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:26.935614 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-5afbf431-07eb-47fb-a208-b95fc65232a7 req-525d01b5-410f-4668-83ff-2482d186b802 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling delete_port for 88b1ce6e-bceb-48d2-9c83-267045746fd4 owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:59:27.066647 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-5afbf431-07eb-47fb-a208-b95fc65232a7 req-525d01b5-410f-4668-83ff-2482d186b802 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:27.080319 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['311b993c-d963-4bbd-9dd2-91f64ff1d918', 'cee3a926-deeb-40c7-8cda-e34f3786308a', '88b1ce6e-bceb-48d2-9c83-267045746fd4'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:59:27.105358 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-525d01b5-410f-4668-83ff-2482d186b802 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Pushing event deleted for resources: {'Port': ['ID=88b1ce6e-bceb-48d2-9c83-267045746fd4,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:27.143998 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-5afbf431-07eb-47fb-a208-b95fc65232a7 req-525d01b5-410f-4668-83ff-2482d186b802 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] No DVR routers for this DVR port 88b1ce6e-bceb-48d2-9c83-267045746fd4 on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:59:27.146580 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-5afbf431-07eb-47fb-a208-b95fc65232a7 req-525d01b5-410f-4668-83ff-2482d186b802 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:27.150327 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5afbf431-07eb-47fb-a208-b95fc65232a7 req-525d01b5-410f-4668-83ff-2482d186b802 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "DELETE /v2.0/ports/88b1ce6e-bceb-48d2-9c83-267045746fd4 HTTP/1.1" status: 204 len: 173 time: 0.4117661 Nov 21 13:59:27.150818 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31a3c09e-663c-428c-8203-cb337ece6c85', 'name': 'network-vif-deleted', 'tag': '88b1ce6e-bceb-48d2-9c83-267045746fd4'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:59:27.153072 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50baca0b-19c7-4b9f-93a8-bbbf52c2acd9" -d '{"events": [{"server_uuid": "31a3c09e-663c-428c-8203-cb337ece6c85", "name": "network-vif-deleted", "tag": "88b1ce6e-bceb-48d2-9c83-267045746fd4"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:59:27.197670 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:59:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f5818e6e-97ea-4db0-828b-117976478caa x-openstack-request-id: req-f5818e6e-97ea-4db0-828b-117976478caa {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:59:27.198023 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "31a3c09e-663c-428c-8203-cb337ece6c85", "name": "network-vif-deleted", "tag": "88b1ce6e-bceb-48d2-9c83-267045746fd4", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:59:27.198334 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-f5818e6e-97ea-4db0-828b-117976478caa {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:59:27.199038 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '31a3c09e-663c-428c-8203-cb337ece6c85', 'name': 'network-vif-deleted', 'tag': '88b1ce6e-bceb-48d2-9c83-267045746fd4', 'status': 'completed', 'code': 200} Nov 21 13:59:27.364751 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3e66f54e-e69c-46fb-bbfc-46c57d0f6499 req-4a94f169-94cb-4ce2-b6b9-bb4407d7d60d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=31a3c09e-663c-428c-8203-cb337ece6c85 HTTP/1.1" status: 200 len: 210 time: 0.0313575 Nov 21 13:59:28.653134 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bceb826-0eb2-4e84-a516-074a01b426af req-88274f7d-c302-4887-8106-b150a71a9b9f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:28.654655 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7bceb826-0eb2-4e84-a516-074a01b426af req-88274f7d-c302-4887-8106-b150a71a9b9f tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 946 time: 0.0510995 Nov 21 13:59:28.701464 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7bceb826-0eb2-4e84-a516-074a01b426af req-ff4ec452-60e2-4b89-85c4-3a16348b4824 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402822 Nov 21 13:59:29.498278 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 88b1ce6e-bceb-48d2-9c83-267045746fd4 no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:59:29.519795 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: 88b1ce6e-bceb-48d2-9c83-267045746fd4 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:59:29.520162 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 88b1ce6e-bceb-48d2-9c83-267045746fd4 not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:59:29.819124 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46be6470-00b1-42e2-8ef5-b90e6f8cfcf6 req-bdb3dffd-fb7e-4c09-8dec-2c9f755c7645 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:29.821167 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-46be6470-00b1-42e2-8ef5-b90e6f8cfcf6 req-bdb3dffd-fb7e-4c09-8dec-2c9f755c7645 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 946 time: 0.0494266 Nov 21 13:59:29.868542 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-46be6470-00b1-42e2-8ef5-b90e6f8cfcf6 req-b0c2358b-a556-46b9-b6e4-ea928ea3aa6d tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414126 Nov 21 13:59:30.095163 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e381432-aef2-46b9-99e2-7ce099a5ee2a req-bc3bb8d2-b518-4241-824c-e7a2912b262e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:30.096625 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4e381432-aef2-46b9-99e2-7ce099a5ee2a req-bc3bb8d2-b518-4241-824c-e7a2912b262e tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 946 time: 0.0467980 Nov 21 13:59:30.191456 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-4e381432-aef2-46b9-99e2-7ce099a5ee2a req-d5c576b0-b21d-4272-a0b7-37bd8aedbc44 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Deleting port cee3a926-deeb-40c7-8cda-e34f3786308a {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:59:30.191823 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-4e381432-aef2-46b9-99e2-7ce099a5ee2a req-d5c576b0-b21d-4272-a0b7-37bd8aedbc44 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:30.212378 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d5a9651e-2373-4143-b173-d42473caa22e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:30.281338 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-4e381432-aef2-46b9-99e2-7ce099a5ee2a req-d5c576b0-b21d-4272-a0b7-37bd8aedbc44 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] For port cee3a926-deeb-40c7-8cda-e34f3786308a, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cee3a926-deeb-40c7-8cda-e34f3786308a,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:59:30.282290 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-4e381432-aef2-46b9-99e2-7ce099a5ee2a req-d5c576b0-b21d-4272-a0b7-37bd8aedbc44 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:30.297975 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-4e381432-aef2-46b9-99e2-7ce099a5ee2a req-d5c576b0-b21d-4272-a0b7-37bd8aedbc44 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling delete_port for cee3a926-deeb-40c7-8cda-e34f3786308a owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:59:30.427058 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-4e381432-aef2-46b9-99e2-7ce099a5ee2a req-d5c576b0-b21d-4272-a0b7-37bd8aedbc44 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:30.438521 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['311b993c-d963-4bbd-9dd2-91f64ff1d918', 'cee3a926-deeb-40c7-8cda-e34f3786308a'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:59:30.453214 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5c576b0-b21d-4272-a0b7-37bd8aedbc44 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Pushing event deleted for resources: {'Port': ['ID=cee3a926-deeb-40c7-8cda-e34f3786308a,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:30.500799 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-4e381432-aef2-46b9-99e2-7ce099a5ee2a req-d5c576b0-b21d-4272-a0b7-37bd8aedbc44 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] No DVR routers for this DVR port cee3a926-deeb-40c7-8cda-e34f3786308a on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:59:30.503170 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-4e381432-aef2-46b9-99e2-7ce099a5ee2a req-d5c576b0-b21d-4272-a0b7-37bd8aedbc44 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:30.506451 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4e381432-aef2-46b9-99e2-7ce099a5ee2a req-d5c576b0-b21d-4272-a0b7-37bd8aedbc44 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "DELETE /v2.0/ports/cee3a926-deeb-40c7-8cda-e34f3786308a HTTP/1.1" status: 204 len: 173 time: 0.4014533 Nov 21 13:59:30.506893 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '23e6a833-20e6-4882-89ae-bd33ce5e4b48', 'name': 'network-vif-deleted', 'tag': 'cee3a926-deeb-40c7-8cda-e34f3786308a'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:59:30.509146 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b8df63bc-0c3b-4cae-8619-b80e9d3816a2" -d '{"events": [{"server_uuid": "23e6a833-20e6-4882-89ae-bd33ce5e4b48", "name": "network-vif-deleted", "tag": "cee3a926-deeb-40c7-8cda-e34f3786308a"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:59:30.558197 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:59:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dd185b1b-94f6-4bb4-a831-21488574c6c9 x-openstack-request-id: req-dd185b1b-94f6-4bb4-a831-21488574c6c9 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:59:30.558489 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "23e6a833-20e6-4882-89ae-bd33ce5e4b48", "name": "network-vif-deleted", "tag": "cee3a926-deeb-40c7-8cda-e34f3786308a", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:59:30.558744 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-dd185b1b-94f6-4bb4-a831-21488574c6c9 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:59:30.559137 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '23e6a833-20e6-4882-89ae-bd33ce5e4b48', 'name': 'network-vif-deleted', 'tag': 'cee3a926-deeb-40c7-8cda-e34f3786308a', 'status': 'completed', 'code': 200} Nov 21 13:59:30.983484 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-97569fbd-e095-42dc-8be4-36eca6c6d608 req-8c177462-75f1-4b40-a8fe-1277a736c1c4 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=23e6a833-20e6-4882-89ae-bd33ce5e4b48 HTTP/1.1" status: 200 len: 210 time: 0.0254803 Nov 21 13:59:32.570777 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-046feb2d-f9a0-4664-addb-f167050746d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:33.372450 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-581f8c7e-3f39-4c6f-adbf-10ac8534ddf7 req-dbe747fa-a3ad-4495-8335-4d70069c3549 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:33.374152 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-581f8c7e-3f39-4c6f-adbf-10ac8534ddf7 req-dbe747fa-a3ad-4495-8335-4d70069c3549 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 945 time: 0.0477936 Nov 21 13:59:33.419997 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-581f8c7e-3f39-4c6f-adbf-10ac8534ddf7 req-958cfe80-e56d-40ee-8643-7f3980ace917 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392771 Nov 21 13:59:33.542186 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device cee3a926-deeb-40c7-8cda-e34f3786308a no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:59:33.561906 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: cee3a926-deeb-40c7-8cda-e34f3786308a {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:59:33.562250 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device cee3a926-deeb-40c7-8cda-e34f3786308a not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:59:33.887789 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:34.532514 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3c00bff-1e8e-4ae4-8372-3606f97ea365 req-68decf86-9b1b-4912-a491-5bf3f742f615 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:34.534492 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c3c00bff-1e8e-4ae4-8372-3606f97ea365 req-68decf86-9b1b-4912-a491-5bf3f742f615 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 945 time: 0.0488229 Nov 21 13:59:34.582665 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c3c00bff-1e8e-4ae4-8372-3606f97ea365 req-3f82ffbb-8705-454c-9b4d-b6bd62f61b45 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/security-groups?id=11093911-4793-47b7-9cc3-82035471327d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424221 Nov 21 13:59:35.078002 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:35.116147 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fae8199-979c-4645-8042-d6712b65ffb4 req-6be075db-9490-49a5-9b28-a60b4fb76b70 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:35.117611 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2fae8199-979c-4645-8042-d6712b65ffb4 req-6be075db-9490-49a5-9b28-a60b4fb76b70 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "GET /v2.0/ports?device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 945 time: 0.0481505 Nov 21 13:59:35.208046 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-2fae8199-979c-4645-8042-d6712b65ffb4 req-59815b86-5f80-481a-be7a-851648f30735 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Deleting port 311b993c-d963-4bbd-9dd2-91f64ff1d918 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 13:59:35.208390 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-2fae8199-979c-4645-8042-d6712b65ffb4 req-59815b86-5f80-481a-be7a-851648f30735 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:35.295465 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-2fae8199-979c-4645-8042-d6712b65ffb4 req-59815b86-5f80-481a-be7a-851648f30735 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] For port 311b993c-d963-4bbd-9dd2-91f64ff1d918, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=311b993c-d963-4bbd-9dd2-91f64ff1d918,segment=NetworkSegment(008340fd-3a9e-413b-878e-432ef5e7b038),segment_id=008340fd-3a9e-413b-878e-432ef5e7b038)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 13:59:35.295855 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-2fae8199-979c-4645-8042-d6712b65ffb4 req-59815b86-5f80-481a-be7a-851648f30735 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:35.309476 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-2fae8199-979c-4645-8042-d6712b65ffb4 req-59815b86-5f80-481a-be7a-851648f30735 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Calling delete_port for 311b993c-d963-4bbd-9dd2-91f64ff1d918 owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 13:59:35.451112 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-2fae8199-979c-4645-8042-d6712b65ffb4 req-59815b86-5f80-481a-be7a-851648f30735 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:35.464305 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['311b993c-d963-4bbd-9dd2-91f64ff1d918'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 13:59:35.483017 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59815b86-5f80-481a-be7a-851648f30735 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Pushing event deleted for resources: {'Port': ['ID=311b993c-d963-4bbd-9dd2-91f64ff1d918,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:35.530960 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-2fae8199-979c-4645-8042-d6712b65ffb4 req-59815b86-5f80-481a-be7a-851648f30735 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] No DVR routers for this DVR port 311b993c-d963-4bbd-9dd2-91f64ff1d918 on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 13:59:35.533645 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-2fae8199-979c-4645-8042-d6712b65ffb4 req-59815b86-5f80-481a-be7a-851648f30735 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:35.536966 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2fae8199-979c-4645-8042-d6712b65ffb4 req-59815b86-5f80-481a-be7a-851648f30735 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.50 "DELETE /v2.0/ports/311b993c-d963-4bbd-9dd2-91f64ff1d918 HTTP/1.1" status: 204 len: 173 time: 0.4123724 Nov 21 13:59:35.537429 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f927cd1-a768-4be7-9ed5-6ea5ee46da8e', 'name': 'network-vif-deleted', 'tag': '311b993c-d963-4bbd-9dd2-91f64ff1d918'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 13:59:35.539734 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c8d7bf56-106f-44ab-8228-b90caeeb051e" -d '{"events": [{"server_uuid": "8f927cd1-a768-4be7-9ed5-6ea5ee46da8e", "name": "network-vif-deleted", "tag": "311b993c-d963-4bbd-9dd2-91f64ff1d918"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 13:59:35.578772 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 13:59:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d5c55889-34bf-494c-97c1-3cf6f79efb95 x-openstack-request-id: req-d5c55889-34bf-494c-97c1-3cf6f79efb95 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 13:59:35.579075 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f927cd1-a768-4be7-9ed5-6ea5ee46da8e", "name": "network-vif-deleted", "tag": "311b993c-d963-4bbd-9dd2-91f64ff1d918", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 13:59:35.579351 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-d5c55889-34bf-494c-97c1-3cf6f79efb95 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 13:59:35.580387 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f927cd1-a768-4be7-9ed5-6ea5ee46da8e', 'name': 'network-vif-deleted', 'tag': '311b993c-d963-4bbd-9dd2-91f64ff1d918', 'status': 'completed', 'code': 200} Nov 21 13:59:35.684342 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-979e9709-533e-43ed-8a87-94402b41bde7 req-342457fd-b88c-4c00-9ee6-b8bc4d35af16 tempest-AttachVolumeNegativeTest-1681899448 tempest-AttachVolumeNegativeTest-1681899448-project] 10.222.0.11 "GET /v2.0/ports?device_id=8f927cd1-a768-4be7-9ed5-6ea5ee46da8e HTTP/1.1" status: 200 len: 210 time: 0.0284135 Nov 21 13:59:35.863843 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:36.739484 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 58324) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:36.782247 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_v2 [None req-4b2fc72a-8fab-424b-860b-9d33b3a98aee admin admin] Deleting subnet 19a08397-ab57-46f7-b983-e6a3bc005bc2 {{(pid=109041) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 13:59:36.785917 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4b2fc72a-8fab-424b-860b-9d33b3a98aee admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:36.818672 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4b2fc72a-8fab-424b-860b-9d33b3a98aee admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4028984'] for subnet, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:36.859284 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4b2fc72a-8fab-424b-860b-9d33b3a98aee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:36.908833 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4b2fc72a-8fab-424b-860b-9d33b3a98aee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3086848', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261005199'] for subnet, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:36.933048 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b2fc72a-8fab-424b-860b-9d33b3a98aee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=19a08397-ab57-46f7-b983-e6a3bc005bc2,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:36.936677 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-4b2fc72a-8fab-424b-860b-9d33b3a98aee admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:36.940345 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-4b2fc72a-8fab-424b-860b-9d33b3a98aee admin admin] 10.222.0.11 "DELETE /v2.0/subnets/19a08397-ab57-46f7-b983-e6a3bc005bc2 HTTP/1.1" status: 204 len: 168 time: 0.1998229 Nov 21 13:59:36.942715 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 58326) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:37.007724 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-49d364f9-3e44-47e5-b2b9-c8a3c5336e04 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:37.086200 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-49d364f9-3e44-47e5-b2b9-c8a3c5336e04 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:37.106059 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-49d364f9-3e44-47e5-b2b9-c8a3c5336e04 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e593a34f-1f09-493d-aafd-a51b70c22643']}} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:59:37.115660 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-49d364f9-3e44-47e5-b2b9-c8a3c5336e04 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '008340fd-3a9e-413b-878e-432ef5e7b038') {'for_net_delete': True} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:59:37.115997 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-49d364f9-3e44-47e5-b2b9-c8a3c5336e04 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '008340fd-3a9e-413b-878e-432ef5e7b038') {} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 13:59:37.125220 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-49d364f9-3e44-47e5-b2b9-c8a3c5336e04 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4028979'] for segment, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:37.137890 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-49d364f9-3e44-47e5-b2b9-c8a3c5336e04 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:37.143647 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-49d364f9-3e44-47e5-b2b9-c8a3c5336e04 admin admin] Releasing vlan 511 on physical network physnet1 to pool {{(pid=109041) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 13:59:37.144122 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-49d364f9-3e44-47e5-b2b9-c8a3c5336e04 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3087018'] for segment, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: Traceback (most recent call last): Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: timer() Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: cb(*args, **kw) Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: return func(*args, **kwargs) Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: self._notify() Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: self.callback(batched_events) Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: event.method(event) Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: return f(self, *a, **k) Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._get(url).json() Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: return self.request(url, 'GET', **kwargs) Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 13:59:37.145693 dv-cinder-768458-12-iscsi neutron-server[109041]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 13:59:37.196962 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-49d364f9-3e44-47e5-b2b9-c8a3c5336e04 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:37.201918 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-49d364f9-3e44-47e5-b2b9-c8a3c5336e04 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:37.205079 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-49d364f9-3e44-47e5-b2b9-c8a3c5336e04 admin admin] 10.222.0.11 "DELETE /v2.0/networks/e593a34f-1f09-493d-aafd-a51b70c22643 HTTP/1.1" status: 204 len: 168 time: 0.2614288 Nov 21 13:59:37.219431 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d364f9-3e44-47e5-b2b9-c8a3c5336e04 admin admin] Pushing event deleted for resources: {'Network': ['ID=e593a34f-1f09-493d-aafd-a51b70c22643,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:37.321080 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 58330) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:37.359465 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-721482c0-0f5d-4399-a383-20eaf9b52ca1 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=48fbf7b5fd2347789241c7658fd6bb83&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0372102 Nov 21 13:59:37.362311 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 58332) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:37.407426 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1e146546-8918-44b9-8862-9afd1edff170 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:37.428693 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1e146546-8918-44b9-8862-9afd1edff170 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:37.473697 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1e146546-8918-44b9-8862-9afd1edff170 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:37.476349 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-1e146546-8918-44b9-8862-9afd1edff170 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:37.477458 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-1e146546-8918-44b9-8862-9afd1edff170 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/11093911-4793-47b7-9cc3-82035471327d HTTP/1.1" status: 204 len: 168 time: 0.1142499 Nov 21 13:59:37.485238 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e146546-8918-44b9-8862-9afd1edff170 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11093911-4793-47b7-9cc3-82035471327d,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:37.545043 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 311b993c-d963-4bbd-9dd2-91f64ff1d918 no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 13:59:37.565754 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: 311b993c-d963-4bbd-9dd2-91f64ff1d918 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 13:59:37.566178 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 311b993c-d963-4bbd-9dd2-91f64ff1d918 not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 13:59:41.095995 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 58400) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:41.196942 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f622843c-21b4-4001-b986-f06459bc3a86 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:41.268162 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f622843c-21b4-4001-b986-f06459bc3a86 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:41.273119 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f622843c-21b4-4001-b986-f06459bc3a86 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:41.311149 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f622843c-21b4-4001-b986-f06459bc3a86 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1328ff94-a724-4df4-bc8b-a3e0c23bc9d4,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:41.316252 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-f622843c-21b4-4001-b986-f06459bc3a86 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=5eab0c74cb5e464d8c9943ee41c77e81&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2192471 Nov 21 13:59:41.318872 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 58404) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:41.365035 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9958f83c-438e-4033-8ecf-5c3a25271433 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:41.386431 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9958f83c-438e-4033-8ecf-5c3a25271433 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:41.433789 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9958f83c-438e-4033-8ecf-5c3a25271433 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:41.436377 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-9958f83c-438e-4033-8ecf-5c3a25271433 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:41.437547 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-9958f83c-438e-4033-8ecf-5c3a25271433 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/1328ff94-a724-4df4-bc8b-a3e0c23bc9d4 HTTP/1.1" status: 204 len: 168 time: 0.1179349 Nov 21 13:59:41.446536 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9958f83c-438e-4033-8ecf-5c3a25271433 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1328ff94-a724-4df4-bc8b-a3e0c23bc9d4,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:42.042524 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 58432) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:42.147487 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-421623952-network', 'tenant_id': 'ff716f99cf444e6e8eda737c0a6d4076'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:59:42.168463 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Made reservation on behalf of ff716f99cf444e6e8eda737c0a6d4076 for: {'network': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:59:42.170768 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:42.178824 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:42.251394 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:42.256594 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:42.280805 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] vlan segment allocate from pool success with {'vlan_id': 545, 'physical_network': 'physnet1'} {{(pid=109041) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:59:42.289589 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=943044ae-13ce-4f6f-98d2-e9d703d1a50f,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:42.295715 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:42.296096 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.segments_db [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Added segment 579e53af-bf0d-477b-9b9e-60b1d7c43bbf of type vlan for network f0609663-c75a-4a66-ba54-ce15485e65bb Nov 21 13:59:42.337510 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:42.361068 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:42.362028 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:42.362608 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:42.415828 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.3721178 Nov 21 13:59:42.418776 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 58438) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:42.422541 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd7d15bf-e338-40b7-afce-14a05638ff51 admin admin] Pushing event updated for resources: {'Network': ['ID=f0609663-c75a-4a66-ba54-ce15485e65bb,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:42.423974 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Request body: {'subnet': {'network_id': 'f0609663-c75a-4a66-ba54-ce15485e65bb', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-421623952-subnet', 'tenant_id': 'ff716f99cf444e6e8eda737c0a6d4076', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:59:42.432010 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network f0609663-c75a-4a66-ba54-ce15485e65bb details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:59:42.446487 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Made reservation on behalf of ff716f99cf444e6e8eda737c0a6d4076 for: {'subnet': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:59:42.448745 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-261670900'] for subnet, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:42.613983 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2298339', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-261670858'] for subnet, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:42.666847 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5e6aed39-b3b6-49e5-8438-e98f216ae1b2,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:42.678809 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:42.679169 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:42.679513 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:42.679892 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:42.680234 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:42.680569 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:42.680900 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:42.681229 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:42.681555 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:42.681879 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:42.682203 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:42.682524 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 13:59:42.685684 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Checking segment: {'id': '579e53af-bf0d-477b-9b9e-60b1d7c43bbf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 545, 'network_id': 'f0609663-c75a-4a66-ba54-ce15485e65bb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109040) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:59:42.686036 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Network hostable DHCP agents. Network: f0609663-c75a-4a66-ba54-ce15485e65bb, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109040) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:59:42.702777 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Network f0609663-c75a-4a66-ba54-ce15485e65bb is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109040) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:59:42.711871 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, f0609663-c75a-4a66-ba54-ce15485e65bb) {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:59:42.715767 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:42.716394 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:42.720632 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e7346c7-952e-49fc-a8f3-6369988d588c None None] Network f0609663-c75a-4a66-ba54-ce15485e65bb requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:59:42.740462 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-0bc4a9a7-9979-4a40-a200-7f67e6428dc1 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3203418 Nov 21 13:59:42.843740 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3a26cea-7e55-43ec-b9a0-299f82344815 None None] Network f0609663-c75a-4a66-ba54-ce15485e65bb requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:59:43.217997 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 58456) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:43.223445 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1499008978-network', 'tenant_id': 'ee60449eb46541bfa4ebb7ddde4b8368'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:59:43.243901 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Made reservation on behalf of ee60449eb46541bfa4ebb7ddde4b8368 for: {'network': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:59:43.246064 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:43.254753 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:43.327628 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:43.332484 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:43.356151 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] vlan segment allocate from pool success with {'vlan_id': 511, 'physical_network': 'physnet1'} {{(pid=109040) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 13:59:43.365531 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9563d3a1-321f-4db3-8b56-63cd5456d8b3,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:43.370194 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:43.370539 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.segments_db [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Added segment a059c9dc-28f9-468d-8c6f-1e17439b33af of type vlan for network 8d398214-14cb-4e68-a4ad-c6f8708ba14b Nov 21 13:59:43.409623 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:43.433255 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:43.434214 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:43.434831 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:43.484761 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.2656829 Nov 21 13:59:43.488218 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 58458) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 13:59:43.494400 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-f781d6b2-d9e9-4f2b-830c-485bdf4bb0c2 admin admin] Request body: {'subnet': {'network_id': '8d398214-14cb-4e68-a4ad-c6f8708ba14b', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1499008978-subnet', 'tenant_id': 'ee60449eb46541bfa4ebb7ddde4b8368', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 13:59:43.498626 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2df0752-859e-49a7-a3b1-0e2e9261fdd7 admin admin] Pushing event updated for resources: {'Network': ['ID=8d398214-14cb-4e68-a4ad-c6f8708ba14b,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:43.510559 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 8d398214-14cb-4e68-a4ad-c6f8708ba14b details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 13:59:43.526593 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f781d6b2-d9e9-4f2b-830c-485bdf4bb0c2 admin admin] Made reservation on behalf of ee60449eb46541bfa4ebb7ddde4b8368 for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 13:59:43.529047 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f781d6b2-d9e9-4f2b-830c-485bdf4bb0c2 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-261005224'] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:43.708689 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f781d6b2-d9e9-4f2b-830c-485bdf4bb0c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3086915', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-261005206'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:43.760901 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f781d6b2-d9e9-4f2b-830c-485bdf4bb0c2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cd9bd75e-47ce-4991-8861-b22c1066ee80,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 13:59:43.770644 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f781d6b2-d9e9-4f2b-830c-485bdf4bb0c2 admin admin] Checking segment: {'id': 'a059c9dc-28f9-468d-8c6f-1e17439b33af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': '8d398214-14cb-4e68-a4ad-c6f8708ba14b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 13:59:43.771002 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f781d6b2-d9e9-4f2b-830c-485bdf4bb0c2 admin admin] Network hostable DHCP agents. Network: 8d398214-14cb-4e68-a4ad-c6f8708ba14b, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 13:59:43.787260 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f781d6b2-d9e9-4f2b-830c-485bdf4bb0c2 admin admin] Network 8d398214-14cb-4e68-a4ad-c6f8708ba14b is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 13:59:43.795711 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-f781d6b2-d9e9-4f2b-830c-485bdf4bb0c2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 8d398214-14cb-4e68-a4ad-c6f8708ba14b) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 13:59:43.800415 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f781d6b2-d9e9-4f2b-830c-485bdf4bb0c2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:43.801048 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f781d6b2-d9e9-4f2b-830c-485bdf4bb0c2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:43.805136 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ece99ff3-09de-47c3-b48d-56dc6b815338 None None] Network 8d398214-14cb-4e68-a4ad-c6f8708ba14b requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:59:43.826274 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-f781d6b2-d9e9-4f2b-830c-485bdf4bb0c2 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3293743 Nov 21 13:59:43.934265 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50d54aa9-1601-4e57-935d-7e6b65669c14 None None] Network 8d398214-14cb-4e68-a4ad-c6f8708ba14b requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 13:59:44.611063 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 13:59:52.604135 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 13:59:57.063992 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-751c6e35-5b8b-427f-a3cd-6187edc91265 req-92d94330-2d8b-4388-b760-dd8ff5edd4eb service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0422881 Nov 21 13:59:57.148506 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751c6e35-5b8b-427f-a3cd-6187edc91265 req-81f701f1-d235-434c-a0cf-2d93e5ef6652 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:57.150001 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-751c6e35-5b8b-427f-a3cd-6187edc91265 req-81f701f1-d235-434c-a0cf-2d93e5ef6652 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=b0b942babf814a7ead64e37a8ded8dff&device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 1098 time: 0.0400164 Nov 21 13:59:57.258488 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751c6e35-5b8b-427f-a3cd-6187edc91265 req-b4a63fd0-eaa2-4f1f-84e1-ac5bde37d3aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:57.259870 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-751c6e35-5b8b-427f-a3cd-6187edc91265 req-b4a63fd0-eaa2-4f1f-84e1-ac5bde37d3aa service neutron] 10.222.0.50 "GET /v2.0/networks?id=6f097009-41cb-4ff1-a076-87e9a8cd07fe HTTP/1.1" status: 200 len: 915 time: 0.0847840 Nov 21 13:59:57.303828 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-751c6e35-5b8b-427f-a3cd-6187edc91265 req-9f86e7f6-a38a-4fef-8917-8e25dbe2e691 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8025d2bd-f151-4446-9381-c3834109dabf HTTP/1.1" status: 200 len: 217 time: 0.0362272 Nov 21 13:59:57.351504 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751c6e35-5b8b-427f-a3cd-6187edc91265 req-3cb9d474-e037-44b5-81b0-32701eddf008 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:57.352931 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-751c6e35-5b8b-427f-a3cd-6187edc91265 req-3cb9d474-e037-44b5-81b0-32701eddf008 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8637d89e-69c8-4f6e-a47d-881de8195666 HTTP/1.1" status: 200 len: 854 time: 0.0422857 Nov 21 13:59:57.384584 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-751c6e35-5b8b-427f-a3cd-6187edc91265 req-60e06400-0d01-429f-9618-66d229a325d3 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=6f097009-41cb-4ff1-a076-87e9a8cd07fe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0239248 Nov 21 13:59:57.474447 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-751c6e35-5b8b-427f-a3cd-6187edc91265 req-d556fb79-9cc6-41aa-9c2b-1a0518c9c657 service neutron] 10.222.0.50 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821710 Nov 21 13:59:57.567774 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-751c6e35-5b8b-427f-a3cd-6187edc91265 req-76058e01-23cf-4510-845d-4fcaa5848dc8 service neutron] 10.222.0.50 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841281 Nov 21 13:59:59.524862 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa718827-5014-421f-b6fe-62138817fc7f req-9bf7226d-b973-4513-86c4-f41bf9579a52 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 13:59:59.526350 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-fa718827-5014-421f-b6fe-62138817fc7f req-9bf7226d-b973-4513-86c4-f41bf9579a52 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 945 time: 0.0489647 Nov 21 13:59:59.573668 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-fa718827-5014-421f-b6fe-62138817fc7f req-154bbc9e-6879-4499-9f0e-e86aeeb91d00 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408940 Nov 21 14:00:00.213774 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-179ee0b5-82d2-49b6-895d-23da6c31d9f1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:00.696751 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28051caf-6b4c-45af-9512-7ddb7711a995 req-022eb478-5d38-4faa-abcd-a755981abc74 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:00.698212 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-28051caf-6b4c-45af-9512-7ddb7711a995 req-022eb478-5d38-4faa-abcd-a755981abc74 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 945 time: 0.0491297 Nov 21 14:00:00.750606 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-28051caf-6b4c-45af-9512-7ddb7711a995 req-4d564654-958d-45d2-9180-187a035dc286 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463660 Nov 21 14:00:01.165885 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-858f126d-899e-4119-809d-ac2f115b620a req-417f3fd0-acdf-4be3-ae3a-0b7f04337d6e tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:01.167290 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-858f126d-899e-4119-809d-ac2f115b620a req-417f3fd0-acdf-4be3-ae3a-0b7f04337d6e tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.50 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 945 time: 0.0460784 Nov 21 14:00:01.262032 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-858f126d-899e-4119-809d-ac2f115b620a req-42b2fcbf-216a-4c68-90b0-bd60f7879ac5 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Deleting port 8025d2bd-f151-4446-9381-c3834109dabf {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:00:01.262370 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-858f126d-899e-4119-809d-ac2f115b620a req-42b2fcbf-216a-4c68-90b0-bd60f7879ac5 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:01.350669 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-858f126d-899e-4119-809d-ac2f115b620a req-42b2fcbf-216a-4c68-90b0-bd60f7879ac5 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] For port 8025d2bd-f151-4446-9381-c3834109dabf, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=8025d2bd-f151-4446-9381-c3834109dabf,segment=NetworkSegment(c0b739a0-f430-4270-99e1-1c9b5f72d8a8),segment_id=c0b739a0-f430-4270-99e1-1c9b5f72d8a8)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:00:01.351038 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-858f126d-899e-4119-809d-ac2f115b620a req-42b2fcbf-216a-4c68-90b0-bd60f7879ac5 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:01.364013 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-858f126d-899e-4119-809d-ac2f115b620a req-42b2fcbf-216a-4c68-90b0-bd60f7879ac5 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling delete_port for 8025d2bd-f151-4446-9381-c3834109dabf owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:00:01.486658 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-858f126d-899e-4119-809d-ac2f115b620a req-42b2fcbf-216a-4c68-90b0-bd60f7879ac5 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:01.503621 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['8025d2bd-f151-4446-9381-c3834109dabf'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 14:00:01.514505 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42b2fcbf-216a-4c68-90b0-bd60f7879ac5 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Pushing event deleted for resources: {'Port': ['ID=8025d2bd-f151-4446-9381-c3834109dabf,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:01.558201 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-858f126d-899e-4119-809d-ac2f115b620a req-42b2fcbf-216a-4c68-90b0-bd60f7879ac5 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] No DVR routers for this DVR port 8025d2bd-f151-4446-9381-c3834109dabf on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 14:00:01.560787 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-858f126d-899e-4119-809d-ac2f115b620a req-42b2fcbf-216a-4c68-90b0-bd60f7879ac5 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:01.565437 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-858f126d-899e-4119-809d-ac2f115b620a req-42b2fcbf-216a-4c68-90b0-bd60f7879ac5 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.50 "DELETE /v2.0/ports/8025d2bd-f151-4446-9381-c3834109dabf HTTP/1.1" status: 204 len: 173 time: 0.3906753 Nov 21 14:00:01.565877 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7fdb301a-82fc-4b66-93ed-988cb00b0a58', 'name': 'network-vif-deleted', 'tag': '8025d2bd-f151-4446-9381-c3834109dabf'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:00:01.568158 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2e9fbda-1894-4e1b-bdff-00707d9e3f49" -d '{"events": [{"server_uuid": "7fdb301a-82fc-4b66-93ed-988cb00b0a58", "name": "network-vif-deleted", "tag": "8025d2bd-f151-4446-9381-c3834109dabf"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:00:01.605307 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 14:00:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f17e3d67-79eb-4b7a-a107-2a83e44d6120 x-openstack-request-id: req-f17e3d67-79eb-4b7a-a107-2a83e44d6120 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:00:01.605603 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7fdb301a-82fc-4b66-93ed-988cb00b0a58", "name": "network-vif-deleted", "tag": "8025d2bd-f151-4446-9381-c3834109dabf", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:00:01.605864 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-f17e3d67-79eb-4b7a-a107-2a83e44d6120 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:00:01.606264 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7fdb301a-82fc-4b66-93ed-988cb00b0a58', 'name': 'network-vif-deleted', 'tag': '8025d2bd-f151-4446-9381-c3834109dabf', 'status': 'completed', 'code': 200} Nov 21 14:00:01.875999 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b0912e2a-3e82-434a-a2d4-744c7b89348c req-4372e32f-02d4-44c6-abb7-b732635571ae tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=7fdb301a-82fc-4b66-93ed-988cb00b0a58 HTTP/1.1" status: 200 len: 210 time: 0.0276859 Nov 21 14:00:02.572037 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-a9090c39-8aa3-45a0-a843-3eda5c85f683 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.342426 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 58664) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:03.388836 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_v2 [None req-6b8b9abe-ea72-4f98-b66a-4eeb6fd4a922 admin admin] Deleting subnet 5e6aed39-b3b6-49e5-8438-e98f216ae1b2 {{(pid=109041) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 14:00:03.391980 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6b8b9abe-ea72-4f98-b66a-4eeb6fd4a922 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.425039 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6b8b9abe-ea72-4f98-b66a-4eeb6fd4a922 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4028984'] for subnet, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.461601 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6b8b9abe-ea72-4f98-b66a-4eeb6fd4a922 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.516695 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6b8b9abe-ea72-4f98-b66a-4eeb6fd4a922 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3086848', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261005199'] for subnet, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.547167 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b8b9abe-ea72-4f98-b66a-4eeb6fd4a922 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5e6aed39-b3b6-49e5-8438-e98f216ae1b2,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:03.549712 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6b8b9abe-ea72-4f98-b66a-4eeb6fd4a922 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.553981 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-6b8b9abe-ea72-4f98-b66a-4eeb6fd4a922 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/5e6aed39-b3b6-49e5-8438-e98f216ae1b2 HTTP/1.1" status: 204 len: 168 time: 0.2105412 Nov 21 14:00:03.555286 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 58666) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:03.620423 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cfd92c17-7b27-4ec7-9237-833fc03cd744 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.698411 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cfd92c17-7b27-4ec7-9237-833fc03cd744 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.718176 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-cfd92c17-7b27-4ec7-9237-833fc03cd744 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f0609663-c75a-4a66-ba54-ce15485e65bb']}} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:00:03.728033 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-cfd92c17-7b27-4ec7-9237-833fc03cd744 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '579e53af-bf0d-477b-9b9e-60b1d7c43bbf') {'for_net_delete': True} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:00:03.728332 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-cfd92c17-7b27-4ec7-9237-833fc03cd744 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '579e53af-bf0d-477b-9b9e-60b1d7c43bbf') {} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:00:03.737345 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cfd92c17-7b27-4ec7-9237-833fc03cd744 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4028979'] for segment, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.750370 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cfd92c17-7b27-4ec7-9237-833fc03cd744 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.756235 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cfd92c17-7b27-4ec7-9237-833fc03cd744 admin admin] Releasing vlan 545 on physical network physnet1 to pool {{(pid=109041) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 14:00:03.756621 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cfd92c17-7b27-4ec7-9237-833fc03cd744 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3087018'] for segment, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: Traceback (most recent call last): Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: timer() Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: cb(*args, **kw) Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: return func(*args, **kwargs) Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: self._notify() Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: self.callback(batched_events) Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: event.method(event) Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: return f(self, *a, **k) Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._get(url).json() Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: return self.request(url, 'GET', **kwargs) Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 14:00:03.758285 dv-cinder-768458-12-iscsi neutron-server[109041]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 14:00:03.813253 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cfd92c17-7b27-4ec7-9237-833fc03cd744 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.817598 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cfd92c17-7b27-4ec7-9237-833fc03cd744 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.820836 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-cfd92c17-7b27-4ec7-9237-833fc03cd744 admin admin] 10.222.0.11 "DELETE /v2.0/networks/f0609663-c75a-4a66-ba54-ce15485e65bb HTTP/1.1" status: 204 len: 168 time: 0.2646148 Nov 21 14:00:03.823661 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 58668) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:03.833979 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfd92c17-7b27-4ec7-9237-833fc03cd744 admin admin] Pushing event deleted for resources: {'Network': ['ID=f0609663-c75a-4a66-ba54-ce15485e65bb,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:03.876446 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_v2 [None req-0d793cf6-0300-4746-b9a3-76e3706d607f admin admin] Deleting subnet cd9bd75e-47ce-4991-8861-b22c1066ee80 {{(pid=109040) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 14:00:03.880769 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0d793cf6-0300-4746-b9a3-76e3706d607f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.892880 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.915710 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0d793cf6-0300-4746-b9a3-76e3706d607f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-261998919'] for subnet, precommit_delete_associations {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:03.952642 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0d793cf6-0300-4746-b9a3-76e3706d607f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.002502 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0d793cf6-0300-4746-b9a3-76e3706d607f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2298272', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261670867'] for subnet, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.030511 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d793cf6-0300-4746-b9a3-76e3706d607f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cd9bd75e-47ce-4991-8861-b22c1066ee80,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:04.036131 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0d793cf6-0300-4746-b9a3-76e3706d607f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.039263 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-0d793cf6-0300-4746-b9a3-76e3706d607f admin admin] 10.222.0.11 "DELETE /v2.0/subnets/cd9bd75e-47ce-4991-8861-b22c1066ee80 HTTP/1.1" status: 204 len: 168 time: 0.2145929 Nov 21 14:00:04.041663 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 58670) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:04.105787 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fdaad4ab-98a4-4093-b1c9-1eb109646c81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.182745 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fdaad4ab-98a4-4093-b1c9-1eb109646c81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.216429 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 8025d2bd-f151-4446-9381-c3834109dabf no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 14:00:04.237120 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: 8025d2bd-f151-4446-9381-c3834109dabf {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 14:00:04.237478 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 8025d2bd-f151-4446-9381-c3834109dabf not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 14:00:04.430041 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-fdaad4ab-98a4-4093-b1c9-1eb109646c81 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8d398214-14cb-4e68-a4ad-c6f8708ba14b']}} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:00:04.440847 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-fdaad4ab-98a4-4093-b1c9-1eb109646c81 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a059c9dc-28f9-468d-8c6f-1e17439b33af') {'for_net_delete': True} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:00:04.441152 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-fdaad4ab-98a4-4093-b1c9-1eb109646c81 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a059c9dc-28f9-468d-8c6f-1e17439b33af') {} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:00:04.449779 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fdaad4ab-98a4-4093-b1c9-1eb109646c81 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-261998924'] for segment, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.462814 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fdaad4ab-98a4-4093-b1c9-1eb109646c81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.468612 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fdaad4ab-98a4-4093-b1c9-1eb109646c81 admin admin] Releasing vlan 511 on physical network physnet1 to pool {{(pid=109040) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 14:00:04.468991 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fdaad4ab-98a4-4093-b1c9-1eb109646c81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2298122'] for segment, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: Traceback (most recent call last): Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: timer() Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: cb(*args, **kw) Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: return func(*args, **kwargs) Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: self._notify() Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: self.callback(batched_events) Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: event.method(event) Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: return f(self, *a, **k) Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._get(url).json() Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: return self.request(url, 'GET', **kwargs) Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 14:00:04.470691 dv-cinder-768458-12-iscsi neutron-server[109040]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 14:00:04.521737 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fdaad4ab-98a4-4093-b1c9-1eb109646c81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.526663 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fdaad4ab-98a4-4093-b1c9-1eb109646c81 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.529795 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-fdaad4ab-98a4-4093-b1c9-1eb109646c81 admin admin] 10.222.0.11 "DELETE /v2.0/networks/8d398214-14cb-4e68-a4ad-c6f8708ba14b HTTP/1.1" status: 204 len: 168 time: 0.4872341 Nov 21 14:00:04.540210 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdaad4ab-98a4-4093-b1c9-1eb109646c81 admin admin] Pushing event deleted for resources: {'Network': ['ID=8d398214-14cb-4e68-a4ad-c6f8708ba14b,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:04.680377 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 58676) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:04.718461 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-3811ae1c-57c3-40c3-8005-37c4aeef1155 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=ff716f99cf444e6e8eda737c0a6d4076&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0368960 Nov 21 14:00:04.721193 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 58678) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:04.769938 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c0db5ae6-53ea-4dbe-aa27-e213461a0a09 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.790395 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c0db5ae6-53ea-4dbe-aa27-e213461a0a09 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.841883 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c0db5ae6-53ea-4dbe-aa27-e213461a0a09 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.844672 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c0db5ae6-53ea-4dbe-aa27-e213461a0a09 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:04.846325 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-c0db5ae6-53ea-4dbe-aa27-e213461a0a09 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/943044ae-13ce-4f6f-98d2-e9d703d1a50f HTTP/1.1" status: 204 len: 168 time: 0.1241608 Nov 21 14:00:04.854056 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0db5ae6-53ea-4dbe-aa27-e213461a0a09 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=943044ae-13ce-4f6f-98d2-e9d703d1a50f,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:05.084032 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:05.154353 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 58686) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:05.193497 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-f74c36e6-5f17-4edc-895e-d53aad1eef92 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=ee60449eb46541bfa4ebb7ddde4b8368&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0379283 Nov 21 14:00:05.195669 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 58688) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:05.241737 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-00266809-ce9f-4c2f-8649-68d90fbed86c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:05.262349 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-00266809-ce9f-4c2f-8649-68d90fbed86c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:05.307752 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-00266809-ce9f-4c2f-8649-68d90fbed86c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:05.310355 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-00266809-ce9f-4c2f-8649-68d90fbed86c admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:05.311487 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-00266809-ce9f-4c2f-8649-68d90fbed86c admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/9563d3a1-321f-4db3-8b56-63cd5456d8b3 HTTP/1.1" status: 204 len: 168 time: 0.1149077 Nov 21 14:00:05.318992 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00266809-ce9f-4c2f-8649-68d90fbed86c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9563d3a1-321f-4db3-8b56-63cd5456d8b3,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:05.865569 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:11.872816 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-c3b06ab6-a454-44e0-a2b7-c892e60d3289 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:11.874246 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-c3b06ab6-a454-44e0-a2b7-c892e60d3289 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/networks?id=6f097009-41cb-4ff1-a076-87e9a8cd07fe HTTP/1.1" status: 200 len: 814 time: 0.1051128 Nov 21 14:00:11.889423 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-9464d902-0c1f-4bc5-9083-79619d9f11a4 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/quotas/b0b942babf814a7ead64e37a8ded8dff HTTP/1.1" status: 200 len: 375 time: 0.0087955 Nov 21 14:00:11.919892 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-ce7c5fca-59d5-4d72-a878-8393b7265fe3 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=b0b942babf814a7ead64e37a8ded8dff&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0248935 Nov 21 14:00:12.010419 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-e410f16b-996a-4ee0-b27d-01e29225aa18 service neutron] 10.222.0.11 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837257 Nov 21 14:00:12.096096 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-129dc4bc-0540-49e2-a3ee-dad3d467609c service neutron] 10.222.0.11 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0795732 Nov 21 14:00:12.249052 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-ef1b68c8-8aa4-44d0-ae2c-d1ffbb4ce4da req-04c7a2f2-0dea-46af-aa69-9dc1a15f3bb5 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 210 time: 0.0278432 Nov 21 14:00:13.464407 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-59446a0b-5921-4b45-b2e4-6579066dc4e8 req-5dc3e0db-f2bb-4cc4-8af2-785fe326547b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 210 time: 0.0302064 Nov 21 14:00:13.510223 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-34a363a8-c9aa-4b1f-aeed-3ee4ad43f9af tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:13.511681 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-34a363a8-c9aa-4b1f-aeed-3ee4ad43f9af tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.50 "GET /v2.0/networks?id=6f097009-41cb-4ff1-a076-87e9a8cd07fe HTTP/1.1" status: 200 len: 814 time: 0.4148605 Nov 21 14:00:13.525577 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Request body: {'port': {'device_id': '1220b80a-6a6b-4c9a-b255-e850222f2666', 'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe', 'admin_state_up': True, 'tenant_id': 'b0b942babf814a7ead64e37a8ded8dff'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:00:13.632688 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Made reservation on behalf of b0b942babf814a7ead64e37a8ded8dff for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 14:00:13.636088 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:13.755302 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Allocated IP 172.20.0.7 (6f097009-41cb-4ff1-a076-87e9a8cd07fe/8637d89e-69c8-4f6e-a47d-881de8195666/b2b26804-5f77-4013-9fe7-1a3d2c194944) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 14:00:13.907087 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:13.938814 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:13.986699 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Network 6f097009-41cb-4ff1-a076-87e9a8cd07fe is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:00:13.989868 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:00:13.992444 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 14:00:14.016392 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Pushing event updated for resources: {'Port': ['ID=b2b26804-5f77-4013-9fe7-1a3d2c194944,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:14.028016 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:14.028365 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:14.028707 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:14.029044 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:14.029378 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:14.029709 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:14.030037 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:14.030366 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:14.030693 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:14.031018 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:14.031343 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:14.031664 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:14.053299 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:14.053939 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:14.069385 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-6f833daf-e96c-4a67-9204-affda7503c88 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5477216 Nov 21 14:00:14.086778 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Request body: {'port': {'device_id': '1220b80a-6a6b-4c9a-b255-e850222f2666', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:00:14.139057 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:14.417438 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b2b26804-5f77-4013-9fe7-1a3d2c194944 {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 14:00:14.424869 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:14.436734 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Transition to ACTIVE for port object b2b26804-5f77-4013-9fe7-1a3d2c194944 will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 14:00:14.441032 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:14.493985 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Pushing event updated for resources: {'Port': ['ID=b2b26804-5f77-4013-9fe7-1a3d2c194944,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:14.561025 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Attempting to bind port b2b26804-5f77-4013-9fe7-1a3d2c194944 on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 14:00:14.561270 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Attempting to bind port b2b26804-5f77-4013-9fe7-1a3d2c194944 by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': 'c0b739a0-f430-4270-99e1-1c9b5f72d8a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 14:00:14.561589 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Attempting to bind port b2b26804-5f77-4013-9fe7-1a3d2c194944 on network 6f097009-41cb-4ff1-a076-87e9a8cd07fe {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:00:14.566531 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Port b2b26804-5f77-4013-9fe7-1a3d2c194944 on network 6f097009-41cb-4ff1-a076-87e9a8cd07fe not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 14:00:14.566847 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Attempting to bind port b2b26804-5f77-4013-9fe7-1a3d2c194944 on network 6f097009-41cb-4ff1-a076-87e9a8cd07fe {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:00:14.572549 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 13, 59, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 14:00:14.572899 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Checking segment: {'id': 'c0b739a0-f430-4270-99e1-1c9b5f72d8a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 14:00:14.573294 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Bound using segment: {'id': 'c0b739a0-f430-4270-99e1-1c9b5f72d8a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 14:00:14.573736 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Bound port: b2b26804-5f77-4013-9fe7-1a3d2c194944, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c0b739a0-f430-4270-99e1-1c9b5f72d8a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 14:00:14.574102 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:14.597704 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a480016-b4b3-4314-8669-b87c4673e774 req-5b10b836-b7c0-4c02-a542-d0cfbf71369b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:14.599200 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-6a480016-b4b3-4314-8669-b87c4673e774 req-5b10b836-b7c0-4c02-a542-d0cfbf71369b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 943 time: 0.0595679 Nov 21 14:00:14.642913 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] For port b2b26804-5f77-4013-9fe7-1a3d2c194944, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 14:00:14.645973 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] For port b2b26804-5f77-4013-9fe7-1a3d2c194944, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=b2b26804-5f77-4013-9fe7-1a3d2c194944,segment=NetworkSegment(c0b739a0-f430-4270-99e1-1c9b5f72d8a8),segment_id=c0b739a0-f430-4270-99e1-1c9b5f72d8a8)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 14:00:14.650503 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:14.651716 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-6a480016-b4b3-4314-8669-b87c4673e774 req-8fb572a2-e842-4d0a-893b-61fb1dc18446 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451825 Nov 21 14:00:14.687060 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:14.687673 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:14.689590 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] 10.222.0.50 "PUT /v2.0/ports/b2b26804-5f77-4013-9fe7-1a3d2c194944 HTTP/1.1" status: 200 len: 1093 time: 0.6062539 Nov 21 14:00:14.690015 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1220b80a-6a6b-4c9a-b255-e850222f2666', 'tag': 'b2b26804-5f77-4013-9fe7-1a3d2c194944'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:00:14.692270 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81c0928c-d8d5-4384-9630-88d17c77a19f" -d '{"events": [{"name": "network-changed", "server_uuid": "1220b80a-6a6b-4c9a-b255-e850222f2666", "tag": "b2b26804-5f77-4013-9fe7-1a3d2c194944"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:00:14.714682 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-231ab1c6-14d6-493c-b012-50aef9f0a32d service neutron] Pushing event updated for resources: {'Port': ['ID=b2b26804-5f77-4013-9fe7-1a3d2c194944,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:14.730947 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 14:00:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-202dff66-a10a-448c-9a1d-6c4a25830a3d x-openstack-request-id: req-202dff66-a10a-448c-9a1d-6c4a25830a3d {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:00:14.731251 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1220b80a-6a6b-4c9a-b255-e850222f2666", "tag": "b2b26804-5f77-4013-9fe7-1a3d2c194944", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:00:14.731513 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-202dff66-a10a-448c-9a1d-6c4a25830a3d {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:00:14.732086 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1220b80a-6a6b-4c9a-b255-e850222f2666', 'tag': 'b2b26804-5f77-4013-9fe7-1a3d2c194944', 'status': 'completed', 'code': 200} Nov 21 14:00:14.775641 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-784e0e49-54ae-42bd-b512-73102e15575e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:14.777151 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-784e0e49-54ae-42bd-b512-73102e15575e service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=b0b942babf814a7ead64e37a8ded8dff&device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 1096 time: 0.0418234 Nov 21 14:00:14.826509 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-31330755-f276-44ca-ac7c-a43a87806ef6 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b2b26804-5f77-4013-9fe7-1a3d2c194944 HTTP/1.1" status: 200 len: 217 time: 0.0366294 Nov 21 14:00:14.880093 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-cb14f4f0-3b1f-4115-89c3-6a8aec63be80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:14.881604 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-cb14f4f0-3b1f-4115-89c3-6a8aec63be80 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8637d89e-69c8-4f6e-a47d-881de8195666 HTTP/1.1" status: 200 len: 854 time: 0.0439820 Nov 21 14:00:14.919391 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-419bd736-19e4-43e0-a23b-7681bb2f47c5 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=6f097009-41cb-4ff1-a076-87e9a8cd07fe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0232286 Nov 21 14:00:15.006181 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-dc62a288-e4a2-406e-ad8e-95a531657d17 service neutron] 10.222.0.50 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0782995 Nov 21 14:00:15.099903 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0a1c46ef-466f-4834-a9f5-233f78172479 req-fde3711c-c4ad-46a7-9a13-c46f5b5c96df service neutron] 10.222.0.50 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815985 Nov 21 14:00:15.190186 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-155dc386-298b-41d3-b65a-b6789ceac56c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:15.191620 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-155dc386-298b-41d3-b65a-b6789ceac56c service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=b0b942babf814a7ead64e37a8ded8dff&device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 1096 time: 0.0401328 Nov 21 14:00:15.284448 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-d5834797-1b9b-42d8-8511-b32f5d086099 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:15.285921 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-d5834797-1b9b-42d8-8511-b32f5d086099 service neutron] 10.222.0.50 "GET /v2.0/networks?id=6f097009-41cb-4ff1-a076-87e9a8cd07fe HTTP/1.1" status: 200 len: 915 time: 0.0857162 Nov 21 14:00:15.333301 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-717cd025-0db1-44e0-8a7b-5bae41c5a5d8 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b2b26804-5f77-4013-9fe7-1a3d2c194944 HTTP/1.1" status: 200 len: 217 time: 0.0334883 Nov 21 14:00:15.387185 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-07f507cf-d334-4876-a9e0-cf0432a9805c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:15.388564 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-07f507cf-d334-4876-a9e0-cf0432a9805c service neutron] 10.222.0.50 "GET /v2.0/subnets?id=8637d89e-69c8-4f6e-a47d-881de8195666 HTTP/1.1" status: 200 len: 854 time: 0.0434923 Nov 21 14:00:15.421215 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-b19e242d-e3be-488a-8786-0f7626f7c3d6 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=6f097009-41cb-4ff1-a076-87e9a8cd07fe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0247412 Nov 21 14:00:15.516300 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-b122d937-674e-4ad0-9845-7f5b35109bd9 service neutron] 10.222.0.50 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866282 Nov 21 14:00:15.611517 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-81c0928c-d8d5-4384-9630-88d17c77a19f req-63888296-6cd1-43d1-b7fa-597829aae79d service neutron] 10.222.0.50 "GET /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862596 Nov 21 14:00:15.766365 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9043222-7ca0-431f-b967-1bcec7c47a17 req-38c1a560-7a50-4538-b16d-4b2d28f6063c tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:15.769109 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e9043222-7ca0-431f-b967-1bcec7c47a17 req-38c1a560-7a50-4538-b16d-4b2d28f6063c tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 943 time: 0.0492654 Nov 21 14:00:15.817180 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e9043222-7ca0-431f-b967-1bcec7c47a17 req-27174154-a6f9-423e-ba89-10b7ca3687ab tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423326 Nov 21 14:00:16.935681 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ef8daf-dae4-46d4-ad14-973fc193f9d3 req-776abf7f-ab3b-4363-a720-003a0cff30be tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:16.937154 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-73ef8daf-dae4-46d4-ad14-973fc193f9d3 req-776abf7f-ab3b-4363-a720-003a0cff30be tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 943 time: 0.0482605 Nov 21 14:00:16.983643 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-73ef8daf-dae4-46d4-ad14-973fc193f9d3 req-9ed3fa3e-ea62-4564-b325-dfb2c445c3f6 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401084 Nov 21 14:00:17.870979 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 58862) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:17.979818 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ebc0c3bd-cf7a-45ef-ab7a-b7b89c89d80b admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.057771 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ebc0c3bd-cf7a-45ef-ab7a-b7b89c89d80b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.062511 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ebc0c3bd-cf7a-45ef-ab7a-b7b89c89d80b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.091495 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device b2b26804-5f77-4013-9fe7-1a3d2c194944 details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 14:00:18.097847 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09e55f3-1e43-4e6f-9180-e0a35ff188f8 req-a22640c3-5b51-4725-ac36-bcb36f63832d tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:18.099242 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebc0c3bd-cf7a-45ef-ab7a-b7b89c89d80b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0da897bb-fe63-49f0-86ff-64473e276b4b,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:18.099382 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e09e55f3-1e43-4e6f-9180-e0a35ff188f8 req-a22640c3-5b51-4725-ac36-bcb36f63832d tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 943 time: 0.0488484 Nov 21 14:00:18.106152 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-ebc0c3bd-cf7a-45ef-ab7a-b7b89c89d80b admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7ee77a47be7549728f463344806cc434&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2317381 Nov 21 14:00:18.107081 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 58868) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:18.156895 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e09e55f3-1e43-4e6f-9180-e0a35ff188f8 req-7cd6a856-30a5-4ea0-8a77-dc1d466b470b tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422859 Nov 21 14:00:18.161864 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6d672610-07cf-4b85-a0ee-afe18278d4ea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.185582 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6d672610-07cf-4b85-a0ee-afe18278d4ea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.195130 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port b2b26804-5f77-4013-9fe7-1a3d2c194944, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=b2b26804-5f77-4013-9fe7-1a3d2c194944,segment=NetworkSegment(c0b739a0-f430-4270-99e1-1c9b5f72d8a8),segment_id=c0b739a0-f430-4270-99e1-1c9b5f72d8a8)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:00:18.206243 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': 'b2b26804-5f77-4013-9fe7-1a3d2c194944', 'network_id': '6f097009-41cb-4ff1-a076-87e9a8cd07fe', 'port_id': 'b2b26804-5f77-4013-9fe7-1a3d2c194944', 'mac_address': 'fa:16:3e:62:08:9f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 518, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8637d89e-69c8-4f6e-a47d-881de8195666', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 14:00:18.231897 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6d672610-07cf-4b85-a0ee-afe18278d4ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.234761 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-6d672610-07cf-4b85-a0ee-afe18278d4ea admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.236484 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-6d672610-07cf-4b85-a0ee-afe18278d4ea admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0da897bb-fe63-49f0-86ff-64473e276b4b HTTP/1.1" status: 204 len: 168 time: 0.1283851 Nov 21 14:00:18.244648 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d672610-07cf-4b85-a0ee-afe18278d4ea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0da897bb-fe63-49f0-86ff-64473e276b4b,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:18.245174 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.265771 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b2b26804-5f77-4013-9fe7-1a3d2c194944 {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 14:00:18.287491 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port b2b26804-5f77-4013-9fe7-1a3d2c194944, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=b2b26804-5f77-4013-9fe7-1a3d2c194944,segment=NetworkSegment(c0b739a0-f430-4270-99e1-1c9b5f72d8a8),segment_id=c0b739a0-f430-4270-99e1-1c9b5f72d8a8)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:00:18.293244 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.344168 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=b2b26804-5f77-4013-9fe7-1a3d2c194944,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:18.352477 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:18.352830 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:18.353166 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:18.353501 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:18.353833 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:18.354164 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:18.354492 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:18.354823 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:18.355142 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:18.355461 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:18.355787 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:18.356129 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:18.504510 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 58874) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:18.517328 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acae9c33-36ad-4bc8-aaaa-7558bc5407f5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.551935 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['b2b26804-5f77-4013-9fe7-1a3d2c194944'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 14:00:18.592446 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acae9c33-36ad-4bc8-aaaa-7558bc5407f5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.596947 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-acae9c33-36ad-4bc8-aaaa-7558bc5407f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.633074 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-acae9c33-36ad-4bc8-aaaa-7558bc5407f5 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=47d249a9a0e54f0ea6d7ad6cfeb1b275&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1274784 Nov 21 14:00:18.635718 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 58876) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:18.643299 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acae9c33-36ad-4bc8-aaaa-7558bc5407f5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9396430c-161f-4c41-a45b-c3388284ad95,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:18.689002 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-df8710f7-c98c-48e4-835c-874a65cd6025 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.709406 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-df8710f7-c98c-48e4-835c-874a65cd6025 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.756064 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-df8710f7-c98c-48e4-835c-874a65cd6025 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.758597 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-df8710f7-c98c-48e4-835c-874a65cd6025 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:18.759739 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-df8710f7-c98c-48e4-835c-874a65cd6025 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/9396430c-161f-4c41-a45b-c3388284ad95 HTTP/1.1" status: 204 len: 168 time: 0.1229393 Nov 21 14:00:18.767577 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df8710f7-c98c-48e4-835c-874a65cd6025 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9396430c-161f-4c41-a45b-c3388284ad95,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:19.275414 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-752754d3-b942-4ce6-ac83-4ad2ecd99e42 req-22b9f561-93ff-440c-ab06-e4e8674acfef tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:19.276926 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-752754d3-b942-4ce6-ac83-4ad2ecd99e42 req-22b9f561-93ff-440c-ab06-e4e8674acfef tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 944 time: 0.0501873 Nov 21 14:00:19.325082 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-752754d3-b942-4ce6-ac83-4ad2ecd99e42 req-c07d7fc0-52e8-424a-b1a4-c95e66dbb212 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421743 Nov 21 14:00:20.090563 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device b2b26804-5f77-4013-9fe7-1a3d2c194944 up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:00:20.140316 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port b2b26804-5f77-4013-9fe7-1a3d2c194944 completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 14:00:20.145026 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port b2b26804-5f77-4013-9fe7-1a3d2c194944 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:00:20.145398 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:20.221838 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:20.244433 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1220b80a-6a6b-4c9a-b255-e850222f2666', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b2b26804-5f77-4013-9fe7-1a3d2c194944'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:00:20.246838 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f844c85c-769b-48cd-8032-1656cf3c565c" -d '{"events": [{"server_uuid": "1220b80a-6a6b-4c9a-b255-e850222f2666", "name": "network-vif-plugged", "status": "completed", "tag": "b2b26804-5f77-4013-9fe7-1a3d2c194944"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:00:20.261230 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port b2b26804-5f77-4013-9fe7-1a3d2c194944, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=b2b26804-5f77-4013-9fe7-1a3d2c194944,segment=NetworkSegment(c0b739a0-f430-4270-99e1-1c9b5f72d8a8),segment_id=c0b739a0-f430-4270-99e1-1c9b5f72d8a8)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:00:20.266098 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:20.294192 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 14:00:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ff53c12c-4a45-4b53-b764-1308ca6851a4 x-openstack-request-id: req-ff53c12c-4a45-4b53-b764-1308ca6851a4 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:00:20.294490 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1220b80a-6a6b-4c9a-b255-e850222f2666", "name": "network-vif-plugged", "status": "completed", "tag": "b2b26804-5f77-4013-9fe7-1a3d2c194944", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:00:20.294748 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-ff53c12c-4a45-4b53-b764-1308ca6851a4 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:00:20.295147 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1220b80a-6a6b-4c9a-b255-e850222f2666', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b2b26804-5f77-4013-9fe7-1a3d2c194944', 'code': 200} Nov 21 14:00:20.321248 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=b2b26804-5f77-4013-9fe7-1a3d2c194944,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:20.445286 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef2b3100-8fe9-4e76-b2f0-2bd8950654cb req-51f2f199-a2f2-460e-96bf-dcb460a1a326 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:20.446987 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ef2b3100-8fe9-4e76-b2f0-2bd8950654cb req-51f2f199-a2f2-460e-96bf-dcb460a1a326 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 945 time: 0.0494761 Nov 21 14:00:20.518662 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddc1272-fcf3-4a4b-85db-3c13b8b606ad req-04645dc6-8bfb-4bfb-adc0-dae5ea80443e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:20.520067 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dddc1272-fcf3-4a4b-85db-3c13b8b606ad req-04645dc6-8bfb-4bfb-adc0-dae5ea80443e service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 1098 time: 0.0831895 Nov 21 14:00:20.524598 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ef2b3100-8fe9-4e76-b2f0-2bd8950654cb req-bfc90871-04c4-47bd-9967-daa3396dcbb6 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703022 Nov 21 14:00:20.567894 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dddc1272-fcf3-4a4b-85db-3c13b8b606ad req-6d5b6142-2263-42c2-b644-999d77fb1ed8 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380423 Nov 21 14:00:21.609451 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:00:21.643866 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc2fb05-8b51-427d-b7c8-44bb33dd48fd req-061babcf-085f-413a-973a-eda934ab7bf9 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:21.645391 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1bc2fb05-8b51-427d-b7c8-44bb33dd48fd req-061babcf-085f-413a-973a-eda934ab7bf9 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 945 time: 0.0524426 Nov 21 14:00:21.693645 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-1bc2fb05-8b51-427d-b7c8-44bb33dd48fd req-e25dde4a-7644-47d9-8960-6391809e44a1 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420933 Nov 21 14:00:22.625816 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:22.811956 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be8af81-b046-4933-ac0f-942aba74b58b req-5ba066ac-29af-48de-b604-0583644e57eb tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:22.813482 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0be8af81-b046-4933-ac0f-942aba74b58b req-5ba066ac-29af-48de-b604-0583644e57eb tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 945 time: 0.0475335 Nov 21 14:00:22.860519 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-0be8af81-b046-4933-ac0f-942aba74b58b req-708caff4-2f9c-4117-b198-0b1d41cd0578 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409882 Nov 21 14:00:30.216323 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4b2b4a69-1d08-46ea-9559-6820dc8c0013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:32.573724 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5909c72d-46e4-4b29-9c67-433b5be29ffa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:33.898452 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:35.084682 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:35.873731 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:41.371392 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59102) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:41.475253 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3cbfd9d7-e547-40b1-a62e-8ec27db720c4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:41.562183 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3cbfd9d7-e547-40b1-a62e-8ec27db720c4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:41.566027 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-3cbfd9d7-e547-40b1-a62e-8ec27db720c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:41.603616 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cbfd9d7-e547-40b1-a62e-8ec27db720c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf842c90-9281-40e3-854d-193534b3296b,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:41.607938 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-3cbfd9d7-e547-40b1-a62e-8ec27db720c4 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=ec715e997a1c446eb2d7b26166c4a9b3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2346134 Nov 21 14:00:41.610465 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59110) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:41.658069 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ac88ad0b-adfc-4243-b31f-48a82a4b36af admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:41.678513 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ac88ad0b-adfc-4243-b31f-48a82a4b36af admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:41.723667 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ac88ad0b-adfc-4243-b31f-48a82a4b36af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:41.726306 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ac88ad0b-adfc-4243-b31f-48a82a4b36af admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:41.727453 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-ac88ad0b-adfc-4243-b31f-48a82a4b36af admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/cf842c90-9281-40e3-854d-193534b3296b HTTP/1.1" status: 204 len: 168 time: 0.1161003 Nov 21 14:00:41.735286 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac88ad0b-adfc-4243-b31f-48a82a4b36af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf842c90-9281-40e3-854d-193534b3296b,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:42.725818 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59150) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:42.808246 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c818902e-ab50-40bf-95b7-21dc49d1c908 req-78b85a12-5b3c-4a07-8d90-a574442eda31 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:42.809735 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c818902e-ab50-40bf-95b7-21dc49d1c908 req-78b85a12-5b3c-4a07-8d90-a574442eda31 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 945 time: 0.0497868 Nov 21 14:00:42.831195 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:42.859957 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c818902e-ab50-40bf-95b7-21dc49d1c908 req-88c4a992-bc91-4ac7-84a2-3d65deb19b02 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441453 Nov 21 14:00:42.903576 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:42.907012 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:42.947077 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=ca798526ee974ef68577471a173f1fcf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2202387 Nov 21 14:00:42.947979 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=132d2f7e-93fe-42e3-8615-af3db70afc5b,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:42.949773 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59154) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:00:42.954973 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:42.955327 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:42.955668 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:42.956080 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:42.956369 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:42.956702 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:42.957036 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:42.957364 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:42.957696 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:42.958049 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:42.958386 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:42.958766 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e04780ea-6556-4279-a7fa-cc08cf9c2028 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:00:43.000120 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7d6114db-095d-4f0e-9f27-75a8ce0ae34a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:43.020173 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7d6114db-095d-4f0e-9f27-75a8ce0ae34a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:43.064920 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7d6114db-095d-4f0e-9f27-75a8ce0ae34a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:43.067724 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-7d6114db-095d-4f0e-9f27-75a8ce0ae34a admin admin] Publish callbacks [] for security_group, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:43.068873 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-7d6114db-095d-4f0e-9f27-75a8ce0ae34a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/132d2f7e-93fe-42e3-8615-af3db70afc5b HTTP/1.1" status: 204 len: 168 time: 0.1180863 Nov 21 14:00:43.076506 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d6114db-095d-4f0e-9f27-75a8ce0ae34a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=132d2f7e-93fe-42e3-8615-af3db70afc5b,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:43.983496 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20caf3c1-116b-4d5c-af65-605233e01573 req-9ec3df0e-550a-46d3-b499-4fa19511e7f2 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:43.985014 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-20caf3c1-116b-4d5c-af65-605233e01573 req-9ec3df0e-550a-46d3-b499-4fa19511e7f2 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 945 time: 0.0524497 Nov 21 14:00:44.038603 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-20caf3c1-116b-4d5c-af65-605233e01573 req-c82f8339-e060-4ff6-a2b1-bcb8428c6a15 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/security-groups?id=53f38c3c-a247-4c77-811f-105c385af4c8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442691 Nov 21 14:00:44.462353 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 req-cb657b57-d7ea-4059-b793-c9d09a0990b9 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:00:44.463782 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 req-cb657b57-d7ea-4059-b793-c9d09a0990b9 tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.50 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 945 time: 0.0471592 Nov 21 14:00:44.558309 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 req-f164c950-0092-4028-964b-ac52e5b2dc8a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Deleting port b2b26804-5f77-4013-9fe7-1a3d2c194944 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:00:44.558573 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 req-f164c950-0092-4028-964b-ac52e5b2dc8a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:44.643560 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 req-f164c950-0092-4028-964b-ac52e5b2dc8a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] For port b2b26804-5f77-4013-9fe7-1a3d2c194944, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=b2b26804-5f77-4013-9fe7-1a3d2c194944,segment=NetworkSegment(c0b739a0-f430-4270-99e1-1c9b5f72d8a8),segment_id=c0b739a0-f430-4270-99e1-1c9b5f72d8a8)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:00:44.643955 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 req-f164c950-0092-4028-964b-ac52e5b2dc8a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:44.656523 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 req-f164c950-0092-4028-964b-ac52e5b2dc8a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Calling delete_port for b2b26804-5f77-4013-9fe7-1a3d2c194944 owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:00:44.780016 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 req-f164c950-0092-4028-964b-ac52e5b2dc8a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:44.802086 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['b2b26804-5f77-4013-9fe7-1a3d2c194944'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 14:00:44.808199 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f164c950-0092-4028-964b-ac52e5b2dc8a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Pushing event deleted for resources: {'Port': ['ID=b2b26804-5f77-4013-9fe7-1a3d2c194944,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:00:44.852755 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 req-f164c950-0092-4028-964b-ac52e5b2dc8a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] No DVR routers for this DVR port b2b26804-5f77-4013-9fe7-1a3d2c194944 on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 14:00:44.855168 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 req-f164c950-0092-4028-964b-ac52e5b2dc8a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:44.858442 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-31b4865e-4e3b-4479-b0fb-056a590eb0b8 req-f164c950-0092-4028-964b-ac52e5b2dc8a tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.50 "DELETE /v2.0/ports/b2b26804-5f77-4013-9fe7-1a3d2c194944 HTTP/1.1" status: 204 len: 173 time: 0.3850946 Nov 21 14:00:44.858883 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1220b80a-6a6b-4c9a-b255-e850222f2666', 'name': 'network-vif-deleted', 'tag': 'b2b26804-5f77-4013-9fe7-1a3d2c194944'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:00:44.861187 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df9479c8-2b19-426b-938f-b05a3041c23d" -d '{"events": [{"server_uuid": "1220b80a-6a6b-4c9a-b255-e850222f2666", "name": "network-vif-deleted", "tag": "b2b26804-5f77-4013-9fe7-1a3d2c194944"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:00:44.902891 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 14:00:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34134112-a254-4bfa-b81d-449ea619a5de x-openstack-request-id: req-34134112-a254-4bfa-b81d-449ea619a5de {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:00:44.903188 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1220b80a-6a6b-4c9a-b255-e850222f2666", "name": "network-vif-deleted", "tag": "b2b26804-5f77-4013-9fe7-1a3d2c194944", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:00:44.903447 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-34134112-a254-4bfa-b81d-449ea619a5de {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:00:44.903878 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1220b80a-6a6b-4c9a-b255-e850222f2666', 'name': 'network-vif-deleted', 'tag': 'b2b26804-5f77-4013-9fe7-1a3d2c194944', 'status': 'completed', 'code': 200} Nov 21 14:00:45.147609 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-17d46ca6-dc62-4c66-9cb2-3aeff9123cfc req-b5f001ae-055c-4c5a-9c38-70304a9fb94d tempest-VolumesSnapshotTestJSON-958796040 tempest-VolumesSnapshotTestJSON-958796040-project] 10.222.0.11 "GET /v2.0/ports?device_id=1220b80a-6a6b-4c9a-b255-e850222f2666 HTTP/1.1" status: 200 len: 210 time: 0.0261128 Nov 21 14:00:48.393970 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device b2b26804-5f77-4013-9fe7-1a3d2c194944 no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 14:00:48.413748 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: b2b26804-5f77-4013-9fe7-1a3d2c194944 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 14:00:48.414096 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device b2b26804-5f77-4013-9fe7-1a3d2c194944 not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 14:00:52.649097 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:00:58.607241 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:01:00.219365 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0da9d20f-b9e1-4d6f-ab09-7e0ae6c65b64 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:02.574375 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0515dc3d-46e8-466d-8d7f-a01af62ab12b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:03.896247 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:05.087015 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:05.866164 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:08.504924 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59384) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:08.608637 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-226791ce-87d0-4cf0-a2dc-48bdd246b099 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:08.685169 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-226791ce-87d0-4cf0-a2dc-48bdd246b099 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:08.688505 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-226791ce-87d0-4cf0-a2dc-48bdd246b099 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:08.725574 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-226791ce-87d0-4cf0-a2dc-48bdd246b099 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=3de082e19f2141fab5da5045e963e3d3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2195797 Nov 21 14:01:08.726425 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-226791ce-87d0-4cf0-a2dc-48bdd246b099 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eda19b87-5587-489f-8730-b89578bd7641,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:08.729029 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59394) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:08.777431 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b39be424-2d5f-4aec-895d-d2184b4ba2b0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:08.800006 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b39be424-2d5f-4aec-895d-d2184b4ba2b0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:08.850926 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b39be424-2d5f-4aec-895d-d2184b4ba2b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:08.853964 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b39be424-2d5f-4aec-895d-d2184b4ba2b0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:08.855126 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-b39be424-2d5f-4aec-895d-d2184b4ba2b0 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/eda19b87-5587-489f-8730-b89578bd7641 HTTP/1.1" status: 204 len: 168 time: 0.1250877 Nov 21 14:01:08.863832 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b39be424-2d5f-4aec-895d-d2184b4ba2b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eda19b87-5587-489f-8730-b89578bd7641,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:14.260532 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59440) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:14.303902 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_v2 [None req-0786f9ce-57f8-4d99-93c5-3d22ba2aa86f admin admin] Deleting subnet 8637d89e-69c8-4f6e-a47d-881de8195666 {{(pid=109040) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 14:01:14.306974 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0786f9ce-57f8-4d99-93c5-3d22ba2aa86f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:14.340800 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0786f9ce-57f8-4d99-93c5-3d22ba2aa86f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-261998919'] for subnet, precommit_delete_associations {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:14.377882 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0786f9ce-57f8-4d99-93c5-3d22ba2aa86f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:14.430632 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0786f9ce-57f8-4d99-93c5-3d22ba2aa86f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2298272', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261670867'] for subnet, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:14.454966 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0786f9ce-57f8-4d99-93c5-3d22ba2aa86f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8637d89e-69c8-4f6e-a47d-881de8195666,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:14.458651 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-0786f9ce-57f8-4d99-93c5-3d22ba2aa86f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:14.462415 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-0786f9ce-57f8-4d99-93c5-3d22ba2aa86f admin admin] 10.222.0.11 "DELETE /v2.0/subnets/8637d89e-69c8-4f6e-a47d-881de8195666 HTTP/1.1" status: 204 len: 168 time: 0.2008860 Nov 21 14:01:14.464878 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59442) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:14.529428 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6f32ae7d-d269-4884-b828-7e19891862fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:14.612091 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6f32ae7d-d269-4884-b828-7e19891862fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:14.632211 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-6f32ae7d-d269-4884-b828-7e19891862fd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f097009-41cb-4ff1-a076-87e9a8cd07fe']}} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:14.641280 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-6f32ae7d-d269-4884-b828-7e19891862fd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c0b739a0-f430-4270-99e1-1c9b5f72d8a8') {'for_net_delete': True} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:14.641580 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-6f32ae7d-d269-4884-b828-7e19891862fd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c0b739a0-f430-4270-99e1-1c9b5f72d8a8') {} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:14.651648 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6f32ae7d-d269-4884-b828-7e19891862fd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-261998924'] for segment, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:14.664259 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6f32ae7d-d269-4884-b828-7e19891862fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:14.669974 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6f32ae7d-d269-4884-b828-7e19891862fd admin admin] Releasing vlan 518 on physical network physnet1 to pool {{(pid=109040) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 14:01:14.670376 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6f32ae7d-d269-4884-b828-7e19891862fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2298122'] for segment, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: Traceback (most recent call last): Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: timer() Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: cb(*args, **kw) Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: return func(*args, **kwargs) Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: self._notify() Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: self.callback(batched_events) Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: event.method(event) Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: return f(self, *a, **k) Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._get(url).json() Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: return self.request(url, 'GET', **kwargs) Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 14:01:14.672088 dv-cinder-768458-12-iscsi neutron-server[109040]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 14:01:14.724114 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6f32ae7d-d269-4884-b828-7e19891862fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:14.729694 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-6f32ae7d-d269-4884-b828-7e19891862fd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:14.732879 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-6f32ae7d-d269-4884-b828-7e19891862fd admin admin] 10.222.0.11 "DELETE /v2.0/networks/6f097009-41cb-4ff1-a076-87e9a8cd07fe HTTP/1.1" status: 204 len: 168 time: 0.2671063 Nov 21 14:01:14.744118 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f32ae7d-d269-4884-b828-7e19891862fd admin admin] Pushing event deleted for resources: {'Network': ['ID=6f097009-41cb-4ff1-a076-87e9a8cd07fe,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:14.890922 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59446) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:14.938418 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-f00ac674-5d13-461f-b76f-98651625c0c6 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=b0b942babf814a7ead64e37a8ded8dff&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0463195 Nov 21 14:01:14.940961 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59448) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:14.985738 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-932852b6-8a64-423e-bf04-f03461ab541c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:15.006374 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-932852b6-8a64-423e-bf04-f03461ab541c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:15.051973 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-932852b6-8a64-423e-bf04-f03461ab541c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:15.055129 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-932852b6-8a64-423e-bf04-f03461ab541c admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:15.056353 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-932852b6-8a64-423e-bf04-f03461ab541c admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/53f38c3c-a247-4c77-811f-105c385af4c8 HTTP/1.1" status: 204 len: 168 time: 0.1144440 Nov 21 14:01:15.063635 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-932852b6-8a64-423e-bf04-f03461ab541c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=53f38c3c-a247-4c77-811f-105c385af4c8,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:15.706990 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59470) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:15.800443 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1634958314-network', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:15.821341 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Made reservation on behalf of db51095fd43e4fe5855207bd0ea7a651 for: {'network': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 14:01:15.823740 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:15.832813 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:15.913753 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:15.917684 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:15.938882 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] vlan segment allocate from pool success with {'vlan_id': 542, 'physical_network': 'physnet1'} {{(pid=109040) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 14:01:15.951780 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88550b36-8ec8-436d-8a8c-4fcf2d7ea3d3,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:15.957341 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:15.957678 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.segments_db [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Added segment 2f57cdde-a3c9-40c0-88f0-211e71097d2d of type vlan for network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 Nov 21 14:01:15.998539 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.021992 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.022917 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:16.023494 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.075398 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.3672972 Nov 21 14:01:16.078292 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59474) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:16.082082 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d161d0-9e98-4a78-8a4a-0230523038aa admin admin] Pushing event updated for resources: {'Network': ['ID=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:16.083168 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Request body: {'subnet': {'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1634958314-subnet', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'ip_version': 4}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:16.091681 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 14:01:16.103605 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Made reservation on behalf of db51095fd43e4fe5855207bd0ea7a651 for: {'subnet': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 14:01:16.107008 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-261005224'] for subnet, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.267478 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3086915', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-261005206'] for subnet, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.323048 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Pushing event updated for resources: {'Subnet': ['ID=31e0485c-71ee-4ce4-8683-27185a5c5f72,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:16.333288 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:16.333581 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:16.333927 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:16.334266 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:16.334600 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:16.335477 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:16.335823 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:16.336159 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:16.336488 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:16.336814 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:16.337139 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:16.337462 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:16.340624 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Checking segment: {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 14:01:16.340983 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Network hostable DHCP agents. Network: 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109041) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 14:01:16.356873 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109041) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 14:01:16.364929 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8) {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:01:16.368801 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:16.369392 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.375103 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-644b4bd8-05c6-48a5-84ab-c4aa378450ac None None] Network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 14:01:16.387428 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59476) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:16.387619 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-323fc600-e108-4b77-85db-550684fbfe9d admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3081553 Nov 21 14:01:16.392284 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:16.413615 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-408660', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-58304'] for router, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.414585 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-473172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-468334', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1610115', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-58419'] for router, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.468146 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.519379 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6b3ed262-49ce-5e18-b10a-0ddd25bea067-4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72'}]}} from dv-cinder-768458-12-iscsi. {{(pid=109042) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 21 14:01:16.520278 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.600924 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.653633 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.db_base_plugin_common [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Allocated IP 172.20.0.2 (4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8/31e0485c-71ee-4ce4-8683-27185a5c5f72/c41a3c92-fc90-499b-be69-ecc313c6c77e) {{(pid=109042) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 14:01:16.795792 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.798945 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Publish callbacks [] for port, precommit_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.804685 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.815266 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.846500 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 is already hosted by enough agents. {{(pid=109042) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:01:16.849277 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.base_scheduler [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Resources bound (agent type, host, resource id): {{(pid=109042) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:01:16.853631 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Received port after_create {{(pid=109042) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 14:01:16.856610 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Pushing event updated for resources: {'Port': ['ID=c41a3c92-fc90-499b-be69-ecc313c6c77e,revision_number=1']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:16.911375 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Attempting to bind port c41a3c92-fc90-499b-be69-ecc313c6c77e on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 14:01:16.911748 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Attempting to bind port c41a3c92-fc90-499b-be69-ecc313c6c77e by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 14:01:16.912146 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Attempting to bind port c41a3c92-fc90-499b-be69-ecc313c6c77e on network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:01:16.917204 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 14, 1, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 14:01:16.917585 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Checking segment: {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 14:01:16.918046 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.918380 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Allocated IP 172.27.1.53 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/a7eec2f6-2747-4e84-adcf-05431129442c) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 14:01:16.918513 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Bound using segment: {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 14:01:16.918844 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Bound port: c41a3c92-fc90-499b-be69-ecc313c6c77e, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 14:01:16.919278 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:16.980255 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] For port c41a3c92-fc90-499b-be69-ecc313c6c77e, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 14:01:16.983327 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] For port c41a3c92-fc90-499b-be69-ecc313c6c77e, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=c41a3c92-fc90-499b-be69-ecc313c6c77e,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 14:01:16.987239 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:17.026933 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:17.047953 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62232ed5-0471-475d-aa5b-e0d7bba4d27f None None] Pushing event updated for resources: {'Port': ['ID=c41a3c92-fc90-499b-be69-ecc313c6c77e,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:17.063007 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:17.104348 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:01:17.107284 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:01:17.110735 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 14:01:17.117031 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Pushing event updated for resources: {'Port': ['ID=a7eec2f6-2747-4e84-adcf-05431129442c,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:17.369807 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:17.555378 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-473263', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-468275'] for router, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:17.681523 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Router 04a22609-002c-4eb7-8a86-c6d6c65e2738 is scheduled to L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 with binding_index 1 {{(pid=109040) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 21 14:01:17.791133 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 14:01:17.800361 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Sync routers for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 14:01:17.811428 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] Publish callbacks [] for router, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:17.812578 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-c4b9bc67-ded6-41d2-8592-0254d506723a admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.4240885 Nov 21 14:01:17.815555 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59478) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:17.829981 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:01:17.829981 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:01:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:17.937013 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:01:17.994123 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ece97c2-3ce3-4668-81d4-17ea5249365c None None] Network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 14:01:18.250766 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Provisioning complete for port c41a3c92-fc90-499b-be69-ecc313c6c77e triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:18.251025 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:18.260788 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:18.411486 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Allocated IP 172.20.0.1 (4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8/31e0485c-71ee-4ce4-8683-27185a5c5f72/dbdeefa8-a396-487a-aa91-907825e1f4f0) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 14:01:18.442648 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:18.462919 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:17Z', 'revision_number': 3, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:18.500337 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Checking router: 04a22609-002c-4eb7-8a86-c6d6c65e2738 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 14:01:18.500641 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Updating router 04a22609-002c-4eb7-8a86-c6d6c65e2738 port a7eec2f6-2747-4e84-adcf-05431129442c binding host dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 14:01:18.523862 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:18.528879 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] For port c41a3c92-fc90-499b-be69-ecc313c6c77e, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=c41a3c92-fc90-499b-be69-ecc313c6c77e,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:01:18.537094 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:18.541401 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:18.570952 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:18.601574 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device c41a3c92-fc90-499b-be69-ecc313c6c77e up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:01:18.619845 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:01:18.623174 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:01:18.626864 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 14:01:18.649408 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Pushing event updated for resources: {'Port': ['ID=dbdeefa8-a396-487a-aa91-907825e1f4f0,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:18.670740 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-470894'] for router_interface, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:18.706560 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Pushing event updated for resources: {'Port': ['ID=c41a3c92-fc90-499b-be69-ecc313c6c77e,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:18.722670 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:18.723023 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:18.723376 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:18.723715 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:18.724088 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:18.724425 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:18.724756 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:18.725089 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:18.725985 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:18.726315 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:18.726633 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:18.726957 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed92f69e-8f04-48b0-840d-dbcbe5815386 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:18.809524 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port c41a3c92-fc90-499b-be69-ecc313c6c77e triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:18.810233 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:18.817808 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:18.836848 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-5e53c8fa-6b46-4b13-992c-3c8fec349b54 None None] Provisioning complete for port c41a3c92-fc90-499b-be69-ecc313c6c77e triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:18.837219 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5e53c8fa-6b46-4b13-992c-3c8fec349b54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:18.984182 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:18.988817 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:19.048833 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Publish callbacks [] for port, precommit_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:19.053782 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1684480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-473342'] for router_interface, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:19.055010 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:19.056275 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Pushing event updated for resources: {'Port': ['ID=dbdeefa8-a396-487a-aa91-907825e1f4f0,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:19.110955 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65333413-bf08-481e-902e-2b2e33e2e779 None None] Pushing event updated for resources: {'Port': ['ID=a7eec2f6-2747-4e84-adcf-05431129442c,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:19.113303 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Attempting to bind port a7eec2f6-2747-4e84-adcf-05431129442c on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 14:01:19.113685 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Attempting to bind port a7eec2f6-2747-4e84-adcf-05431129442c by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 14:01:19.114055 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Attempting to bind port a7eec2f6-2747-4e84-adcf-05431129442c on network 67069811-a3d5-4953-8a57-e62d44750fe3 {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:01:19.119794 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 14, 1, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 14:01:19.120213 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Checking segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 14:01:19.120616 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:19.121005 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Bound using segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 14:01:19.121476 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Bound port: a7eec2f6-2747-4e84-adcf-05431129442c, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 14:01:19.122126 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:19.151879 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:01:19.153425 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:01:19.180736 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-a7efd5e3-c18d-447e-9300-ac548671ce58 None None] Provisioning complete for port dbdeefa8-a396-487a-aa91-907825e1f4f0 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:19.181115 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-a7efd5e3-c18d-447e-9300-ac548671ce58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:19.184708 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] For port a7eec2f6-2747-4e84-adcf-05431129442c, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 14:01:19.220862 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] For port a7eec2f6-2747-4e84-adcf-05431129442c, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=a7eec2f6-2747-4e84-adcf-05431129442c,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 14:01:19.227955 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-a7efd5e3-c18d-447e-9300-ac548671ce58 None None] Port dbdeefa8-a396-487a-aa91-907825e1f4f0 cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 14:01:19.230020 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:19.278633 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Router 04a22609-002c-4eb7-8a86-c6d6c65e2738 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 14:01:19.291688 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65333413-bf08-481e-902e-2b2e33e2e779 None None] Pushing event updated for resources: {'Port': ['ID=a7eec2f6-2747-4e84-adcf-05431129442c,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:19.297359 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:01:19.297900 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:01:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:19.392258 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 14:01:19.398059 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-0ca20431-5160-4670-a092-88d4fc0e74d5 admin admin] 10.222.0.11 "PUT /v2.0/routers/04a22609-002c-4eb7-8a86-c6d6c65e2738/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5808146 Nov 21 14:01:19.407693 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:01:19.487649 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-6f9adc60-ed31-423a-8a7c-5505faf32f82 None None] Provisioning complete for port dbdeefa8-a396-487a-aa91-907825e1f4f0 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:19.488041 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6f9adc60-ed31-423a-8a7c-5505faf32f82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:19.560591 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-6f9adc60-ed31-423a-8a7c-5505faf32f82 None None] Port dbdeefa8-a396-487a-aa91-907825e1f4f0 cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 14:01:19.650153 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 2, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:19.676232 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de13cb00-2dd0-416b-b075-59c8a0992917 None None] The sync data for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi is: [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 2, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 14:01:19.889944 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59494) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:19.895840 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1599347875-network', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:19.917109 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Made reservation on behalf of fbf5da1d0dab4233b3314e754324060f for: {'network': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 14:01:19.919640 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for network, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:19.930184 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.007273 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.011289 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.036455 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] vlan segment allocate from pool success with {'vlan_id': 513, 'physical_network': 'physnet1'} {{(pid=109041) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 21 14:01:20.046934 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=84d4b291-76b2-49d2-829a-d3327e04a971,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:20.051798 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.052170 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.segments_db [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Added segment 55d0e716-c4c3-4fb4-9184-bc6611b0fac3 of type vlan for network 0d56e568-78a2-4494-ad2a-4019474745a2 Nov 21 14:01:20.092650 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731000021005'] for network, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.121363 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498'] for network, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.122691 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:20.123318 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.183322 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.2922368 Nov 21 14:01:20.186378 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59496) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:20.188791 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-877969e1-9528-4fb3-ade1-2be6b4ac8b23 admin admin] Pushing event updated for resources: {'Network': ['ID=0d56e568-78a2-4494-ad2a-4019474745a2,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:20.192681 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-b59954cc-f4bf-4b11-b019-ddc88b967c6e admin admin] Request body: {'subnet': {'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1599347875-subnet', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'ip_version': 4}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:20.202104 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Network 0d56e568-78a2-4494-ad2a-4019474745a2 details requested by agent ovs-agent-dv-cinder-768458-12-iscsi with host dv-cinder-768458-12-iscsi {{(pid=109042) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 21 14:01:20.226816 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b59954cc-f4bf-4b11-b019-ddc88b967c6e admin admin] Made reservation on behalf of fbf5da1d0dab4233b3314e754324060f for: {'subnet': 1} {{(pid=109040) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 14:01:20.229094 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b59954cc-f4bf-4b11-b019-ddc88b967c6e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-261670900'] for subnet, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.430638 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b59954cc-f4bf-4b11-b019-ddc88b967c6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2298339', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-261670858'] for subnet, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.480800 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b59954cc-f4bf-4b11-b019-ddc88b967c6e admin admin] Pushing event updated for resources: {'Subnet': ['ID=c1c9af2b-6794-4f3a-a1b2-f58aefe762f8,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:20.499390 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b59954cc-f4bf-4b11-b019-ddc88b967c6e admin admin] Checking segment: {'id': '55d0e716-c4c3-4fb4-9184-bc6611b0fac3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109040) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 14:01:20.499759 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b59954cc-f4bf-4b11-b019-ddc88b967c6e admin admin] Network hostable DHCP agents. Network: 0d56e568-78a2-4494-ad2a-4019474745a2, hostable agents: ['728ca121-ce0c-4add-bb99-cb86109c5802'], hosted agents: [] {{(pid=109040) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 21 14:01:20.520887 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b59954cc-f4bf-4b11-b019-ddc88b967c6e admin admin] Network 0d56e568-78a2-4494-ad2a-4019474745a2 is scheduled to be hosted by DHCP agent 728ca121-ce0c-4add-bb99-cb86109c5802 with binding_index 1 {{(pid=109040) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 21 14:01:20.531387 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-b59954cc-f4bf-4b11-b019-ddc88b967c6e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-768458-12-iscsi, 0d56e568-78a2-4494-ad2a-4019474745a2) {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:01:20.536503 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b59954cc-f4bf-4b11-b019-ddc88b967c6e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:20.537364 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b59954cc-f4bf-4b11-b019-ddc88b967c6e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.543239 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41b2c13a-f818-49a8-a434-17e8a77204a5 None None] Network 0d56e568-78a2-4494-ad2a-4019474745a2 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 14:01:20.555847 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-b59954cc-f4bf-4b11-b019-ddc88b967c6e admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3666248 Nov 21 14:01:20.557489 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59498) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:20.562953 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1599347875-router', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:20.593063 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-408660', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-58304'] for router, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.594096 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-473172', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-468334', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1610115', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-58419'] for router, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.624588 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device a7eec2f6-2747-4e84-adcf-05431129442c up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:01:20.662205 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.739853 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port a7eec2f6-2747-4e84-adcf-05431129442c triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:20.740253 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:20.799085 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6b3ed262-49ce-5e18-b10a-0ddd25bea067-0d56e568-78a2-4494-ad2a-4019474745a2', 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'fixed_ips': [{'subnet_id': 'c1c9af2b-6794-4f3a-a1b2-f58aefe762f8'}]}} from dv-cinder-768458-12-iscsi. {{(pid=109042) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 21 14:01:20.800130 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.060776 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.077317 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.110135 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port a7eec2f6-2747-4e84-adcf-05431129442c, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=a7eec2f6-2747-4e84-adcf-05431129442c,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:01:21.117699 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.118460 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device c41a3c92-fc90-499b-be69-ecc313c6c77e up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:01:21.125209 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.db_base_plugin_common [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Allocated IP 172.20.0.2 (0d56e568-78a2-4494-ad2a-4019474745a2/c1c9af2b-6794-4f3a-a1b2-f58aefe762f8/37d17356-5acc-4725-b0f4-08bb6e5ed393) {{(pid=109042) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 14:01:21.250367 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=a7eec2f6-2747-4e84-adcf-05431129442c,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:21.273624 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.277738 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port c41a3c92-fc90-499b-be69-ecc313c6c77e triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:21.278113 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.294108 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.374296 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Publish callbacks [] for port, precommit_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.400280 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846'] for port, after_create {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.401033 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Allocated IP 172.27.1.49 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/1736e9cb-1855-467f-bf4b-333bddef6d70) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 14:01:21.460021 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Network 0d56e568-78a2-4494-ad2a-4019474745a2 is already hosted by enough agents. {{(pid=109042) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:01:21.463949 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Pushing event updated for resources: {'Port': ['ID=37d17356-5acc-4725-b0f4-08bb6e5ed393,revision_number=1']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:21.467247 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.scheduler.base_scheduler [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Resources bound (agent type, host, resource id): {{(pid=109042) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:01:21.469529 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Received port after_create {{(pid=109042) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 14:01:21.517782 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.525627 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Attempting to bind port 37d17356-5acc-4725-b0f4-08bb6e5ed393 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 14:01:21.526007 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Attempting to bind port 37d17356-5acc-4725-b0f4-08bb6e5ed393 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '55d0e716-c4c3-4fb4-9184-bc6611b0fac3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 14:01:21.526374 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Attempting to bind port 37d17356-5acc-4725-b0f4-08bb6e5ed393 on network 0d56e568-78a2-4494-ad2a-4019474745a2 {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:01:21.531561 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 14, 1, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 14:01:21.532103 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Checking segment: {'id': '55d0e716-c4c3-4fb4-9184-bc6611b0fac3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 14:01:21.532524 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.532923 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Bound using segment: {'id': '55d0e716-c4c3-4fb4-9184-bc6611b0fac3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 14:01:21.533395 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Bound port: 37d17356-5acc-4725-b0f4-08bb6e5ed393, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '55d0e716-c4c3-4fb4-9184-bc6611b0fac3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 14:01:21.533780 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.554596 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.597911 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:01:21.600965 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:01:21.601479 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] For port 37d17356-5acc-4725-b0f4-08bb6e5ed393, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 14:01:21.603534 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 14:01:21.604925 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] For port 37d17356-5acc-4725-b0f4-08bb6e5ed393, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=37d17356-5acc-4725-b0f4-08bb6e5ed393,segment=NetworkSegment(55d0e716-c4c3-4fb4-9184-bc6611b0fac3),segment_id=55d0e716-c4c3-4fb4-9184-bc6611b0fac3)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 14:01:21.611509 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Pushing event updated for resources: {'Port': ['ID=1736e9cb-1855-467f-bf4b-333bddef6d70,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:21.612526 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:21.668115 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cc1325e-f457-4f29-9e45-fc3f8d33b6e7 None None] Pushing event updated for resources: {'Port': ['ID=37d17356-5acc-4725-b0f4-08bb6e5ed393,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:21.775954 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Sync routers for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 14:01:21.786978 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:01:21.787626 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:01:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:21.906840 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:22.006942 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:01:22.115741 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-473263', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-468275'] for router, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:22.203483 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 2, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:22.228426 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Checking router: 04a22609-002c-4eb7-8a86-c6d6c65e2738 for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 14:01:22.228782 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Updating router 04a22609-002c-4eb7-8a86-c6d6c65e2738 port dbdeefa8-a396-487a-aa91-907825e1f4f0 binding host dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 14:01:22.246527 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Router a62177be-9f50-4579-8ec7-523c26060526 is scheduled to L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 with binding_index 1 {{(pid=109041) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 21 14:01:22.257968 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:22.357953 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 14:01:22.369907 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Sync routers for ids ['a62177be-9f50-4579-8ec7-523c26060526'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 14:01:22.378348 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] Publish callbacks [] for router, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:22.382916 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-f6c2fea2-9cae-4190-884d-59e14bdbea81 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.8214757 Nov 21 14:01:22.383080 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Routers {'a62177be-9f50-4579-8ec7-523c26060526'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:01:22.383263 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59500) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:22.383782 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:01:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['a62177be-9f50-4579-8ec7-523c26060526'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:22.503551 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Set router a62177be-9f50-4579-8ec7-523c26060526 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:01:22.582013 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Publish callbacks [] for port, precommit_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:22.591597 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:22.663510 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Pushing event updated for resources: {'Port': ['ID=dbdeefa8-a396-487a-aa91-907825e1f4f0,revision_number=3']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:22.673869 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:22.674692 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:22.674888 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:22.675295 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:22.675787 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:22.676469 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:22.676759 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:22.676998 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:22.677457 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:22.677795 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:22.678116 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:22.679545 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109043) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:01:22.681914 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:22.740644 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device a7eec2f6-2747-4e84-adcf-05431129442c up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:01:22.753221 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Attempting to bind port dbdeefa8-a396-487a-aa91-907825e1f4f0 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 14:01:22.753599 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Attempting to bind port dbdeefa8-a396-487a-aa91-907825e1f4f0 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 14:01:22.753966 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Attempting to bind port dbdeefa8-a396-487a-aa91-907825e1f4f0 on network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:01:22.764115 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 14, 1, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 14:01:22.764494 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Checking segment: {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109043) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 14:01:22.764899 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:22.765290 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Bound using segment: {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 14:01:22.765755 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Bound port: dbdeefa8-a396-487a-aa91-907825e1f4f0, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'}}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 14:01:22.766132 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:22.786376 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3519e6ff-362e-4a6d-81be-f939d7e3a637 None None] Network 0d56e568-78a2-4494-ad2a-4019474745a2 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 14:01:22.843504 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] For port dbdeefa8-a396-487a-aa91-907825e1f4f0, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109043) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 14:01:22.847316 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] For port dbdeefa8-a396-487a-aa91-907825e1f4f0, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=dbdeefa8-a396-487a-aa91-907825e1f4f0,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109043) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 14:01:22.848826 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a62177be-9f50-4579-8ec7-523c26060526', 'name': 'tempest-TestVolumeBootPattern-1599347875-router', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49'}], 'enable_snat': True}, 'gw_port_id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:20Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 3, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'gw_port': {'id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:c1:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:21Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:22.859686 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:22.900845 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Checking router: a62177be-9f50-4579-8ec7-523c26060526 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 14:01:22.901189 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Updating router a62177be-9f50-4579-8ec7-523c26060526 port 1736e9cb-1855-467f-bf4b-333bddef6d70 binding host dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 14:01:22.909262 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-d4596e9f-d3dd-4828-a5ed-b4c3e918a110 None None] Provisioning complete for port 37d17356-5acc-4725-b0f4-08bb6e5ed393 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:22.909630 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d4596e9f-d3dd-4828-a5ed-b4c3e918a110 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:22.945651 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7cf615e-e287-406d-b599-c0281c310b30 None None] Pushing event updated for resources: {'Port': ['ID=dbdeefa8-a396-487a-aa91-907825e1f4f0,revision_number=4']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:22.950921 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:01:22.952164 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:01:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:22.989090 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:22.992595 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.026555 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port a7eec2f6-2747-4e84-adcf-05431129442c triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:23.026923 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.078789 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:01:23.159574 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Allocated IP 172.20.0.1 (0d56e568-78a2-4494-ad2a-4019474745a2/c1c9af2b-6794-4f3a-a1b2-f58aefe762f8/602b0509-a9ca-469e-ac5d-1511520423f7) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 14:01:23.264739 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.282985 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d4596e9f-d3dd-4828-a5ed-b4c3e918a110 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.300156 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.303122 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:22Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:23.333686 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7a3375ce-0956-4a3b-b60e-5f41a04cec64 None None] The sync data for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi is: [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:22Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 14:01:23.343146 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Network 0d56e568-78a2-4494-ad2a-4019474745a2 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:01:23.346485 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:01:23.350258 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 14:01:23.378879 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Pushing event updated for resources: {'Port': ['ID=602b0509-a9ca-469e-ac5d-1511520423f7,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:23.402787 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-470894'] for router_interface, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.497719 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 37d17356-5acc-4725-b0f4-08bb6e5ed393 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:01:23.539033 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.544691 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-d4596e9f-d3dd-4828-a5ed-b4c3e918a110 None None] For port 37d17356-5acc-4725-b0f4-08bb6e5ed393, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=37d17356-5acc-4725-b0f4-08bb6e5ed393,segment=NetworkSegment(55d0e716-c4c3-4fb4-9184-bc6611b0fac3),segment_id=55d0e716-c4c3-4fb4-9184-bc6611b0fac3)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:01:23.561397 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d4596e9f-d3dd-4828-a5ed-b4c3e918a110 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.688590 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4596e9f-d3dd-4828-a5ed-b4c3e918a110 None None] Pushing event updated for resources: {'Port': ['ID=37d17356-5acc-4725-b0f4-08bb6e5ed393,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:23.726830 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Publish callbacks [] for port, precommit_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.730387 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-aaeed3c3-908c-4a40-82a2-128f3a3fa0a3 None None] Provisioning complete for port dbdeefa8-a396-487a-aa91-907825e1f4f0 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:23.730702 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-aaeed3c3-908c-4a40-82a2-128f3a3fa0a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.732624 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 37d17356-5acc-4725-b0f4-08bb6e5ed393 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:23.732989 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.790790 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.863072 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Attempting to bind port 1736e9cb-1855-467f-bf4b-333bddef6d70 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 14:01:23.863448 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Attempting to bind port 1736e9cb-1855-467f-bf4b-333bddef6d70 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 14:01:23.863916 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Attempting to bind port 1736e9cb-1855-467f-bf4b-333bddef6d70 on network 67069811-a3d5-4953-8a57-e62d44750fe3 {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:01:23.884324 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7472716-4167-48be-99dc-8551e3b4a1ae None None] Pushing event updated for resources: {'Port': ['ID=1736e9cb-1855-467f-bf4b-333bddef6d70,revision_number=2']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:23.897787 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 14, 1, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 14:01:23.898357 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Checking segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109042) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 14:01:23.898776 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.899180 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Bound using segment: {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'} {{(pid=109042) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 14:01:23.899680 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.managers [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Bound port: 1736e9cb-1855-467f-bf4b-333bddef6d70, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c0e7cfc-5b14-4551-b79a-294ec69a8c15', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3'}}] {{(pid=109042) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 14:01:23.900096 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.981342 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:23.987717 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2298230'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:24.025084 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-aaeed3c3-908c-4a40-82a2-128f3a3fa0a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:24.027329 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] For port 1736e9cb-1855-467f-bf4b-333bddef6d70, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109042) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 14:01:24.031609 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] For port 1736e9cb-1855-467f-bf4b-333bddef6d70, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=1736e9cb-1855-467f-bf4b-333bddef6d70,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 14:01:24.041351 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:24.059194 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Pushing event updated for resources: {'Port': ['ID=602b0509-a9ca-469e-ac5d-1511520423f7,revision_number=2']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:24.070989 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1684480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-473342'] for router_interface, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:24.121939 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-aaeed3c3-908c-4a40-82a2-128f3a3fa0a3 None None] For port dbdeefa8-a396-487a-aa91-907825e1f4f0, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=dbdeefa8-a396-487a-aa91-907825e1f4f0,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:01:24.129886 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7472716-4167-48be-99dc-8551e3b4a1ae None None] Pushing event updated for resources: {'Port': ['ID=1736e9cb-1855-467f-bf4b-333bddef6d70,revision_number=3']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:24.133124 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-aaeed3c3-908c-4a40-82a2-128f3a3fa0a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:24.137397 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Routers {'a62177be-9f50-4579-8ec7-523c26060526'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:01:24.138045 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:01:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['a62177be-9f50-4579-8ec7-523c26060526'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:24.172619 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Network 0d56e568-78a2-4494-ad2a-4019474745a2 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:01:24.174342 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:01:24.276341 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaeed3c3-908c-4a40-82a2-128f3a3fa0a3 None None] Pushing event updated for resources: {'Port': ['ID=dbdeefa8-a396-487a-aa91-907825e1f4f0,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:24.297384 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-c782f8bf-f261-4cfa-83de-92684a8c8553 None None] Provisioning complete for port 602b0509-a9ca-469e-ac5d-1511520423f7 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:24.297764 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c782f8bf-f261-4cfa-83de-92684a8c8553 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:24.303200 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Router a62177be-9f50-4579-8ec7-523c26060526 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 14:01:24.323640 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] Set router a62177be-9f50-4579-8ec7-523c26060526 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:01:24.379844 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-c782f8bf-f261-4cfa-83de-92684a8c8553 None None] Port 602b0509-a9ca-469e-ac5d-1511520423f7 cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 14:01:24.416573 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 14:01:24.435832 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-b4c2280c-e257-40c5-b6b9-14d2bf8a1860 admin admin] 10.222.0.11 "PUT /v2.0/routers/a62177be-9f50-4579-8ec7-523c26060526/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0363767 Nov 21 14:01:24.455930 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-c782f8bf-f261-4cfa-83de-92684a8c8553 None None] Provisioning complete for port 37d17356-5acc-4725-b0f4-08bb6e5ed393 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:24.456320 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c782f8bf-f261-4cfa-83de-92684a8c8553 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:24.578139 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device dbdeefa8-a396-487a-aa91-907825e1f4f0 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:01:24.664416 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a62177be-9f50-4579-8ec7-523c26060526', 'name': 'tempest-TestVolumeBootPattern-1599347875-router', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49'}], 'enable_snat': True}, 'gw_port_id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:20Z', 'updated_at': '2021-11-21T14:01:23Z', 'revision_number': 4, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'gw_port': {'id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:c1:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:21Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '602b0509-a9ca-469e-ac5d-1511520423f7', 'name': '', 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'mac_address': 'fa:16:3e:d0:ca:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'c1c9af2b-6794-4f3a-a1b2-f58aefe762f8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:23Z', 'updated_at': '2021-11-21T14:01:23Z', 'revision_number': 2, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'subnets': [{'id': 'c1c9af2b-6794-4f3a-a1b2-f58aefe762f8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:24.692358 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-041afac5-52f1-4307-bd3a-b84c84c11f7a None None] The sync data for ids ['a62177be-9f50-4579-8ec7-523c26060526'] in dv-cinder-768458-12-iscsi is: [{'id': 'a62177be-9f50-4579-8ec7-523c26060526', 'name': 'tempest-TestVolumeBootPattern-1599347875-router', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49'}], 'enable_snat': True}, 'gw_port_id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:20Z', 'updated_at': '2021-11-21T14:01:23Z', 'revision_number': 4, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'gw_port': {'id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:c1:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:21Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '602b0509-a9ca-469e-ac5d-1511520423f7', 'name': '', 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'mac_address': 'fa:16:3e:d0:ca:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'c1c9af2b-6794-4f3a-a1b2-f58aefe762f8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:23Z', 'updated_at': '2021-11-21T14:01:23Z', 'revision_number': 2, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'subnets': [{'id': 'c1c9af2b-6794-4f3a-a1b2-f58aefe762f8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 14:01:24.694920 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port dbdeefa8-a396-487a-aa91-907825e1f4f0 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:24.695534 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:24.785345 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 37d17356-5acc-4725-b0f4-08bb6e5ed393 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:01:24.788250 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-cf374284-8c2d-4687-8f35-1f4fda556a32 None None] Provisioning complete for port 602b0509-a9ca-469e-ac5d-1511520423f7 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:24.788250 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-cf374284-8c2d-4687-8f35-1f4fda556a32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:24.850278 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-cf374284-8c2d-4687-8f35-1f4fda556a32 None None] Port 602b0509-a9ca-469e-ac5d-1511520423f7 cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 14:01:24.865184 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 37d17356-5acc-4725-b0f4-08bb6e5ed393 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:24.865862 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:24.980071 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59508) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:24.984657 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-07b1ea3f-2a50-45c3-ae12-c4ec5096287c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-847620947', 'description': 'tempest-secgroup-smoke-847620947 description', 'project_id': 'db51095fd43e4fe5855207bd0ea7a651'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:25.007093 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07b1ea3f-2a50-45c3-ae12-c4ec5096287c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.087205 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07b1ea3f-2a50-45c3-ae12-c4ec5096287c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.091358 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07b1ea3f-2a50-45c3-ae12-c4ec5096287c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.119300 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-07b1ea3f-2a50-45c3-ae12-c4ec5096287c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.123688 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-07b1ea3f-2a50-45c3-ae12-c4ec5096287c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1394856 Nov 21 14:01:25.123948 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59510) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:25.129072 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-551a8b26-99ef-42f0-acf8-008ea23af91f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Request body: {'security_group_rule': {'security_group_id': '238d71da-b989-4fea-9e58-80ca9534d132', 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:25.135158 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07b1ea3f-2a50-45c3-ae12-c4ec5096287c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'SecurityGroup': ['ID=238d71da-b989-4fea-9e58-80ca9534d132,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:25.159692 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-551a8b26-99ef-42f0-acf8-008ea23af91f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.220162 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-551a8b26-99ef-42f0-acf8-008ea23af91f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.224703 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-551a8b26-99ef-42f0-acf8-008ea23af91f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.243004 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-551a8b26-99ef-42f0-acf8-008ea23af91f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0a54a48e-c143-46d6-aa32-e24addd578f8,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:25.252865 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-551a8b26-99ef-42f0-acf8-008ea23af91f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.257664 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-551a8b26-99ef-42f0-acf8-008ea23af91f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1292734 Nov 21 14:01:25.257773 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59512) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:25.262285 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-817c1ac8-2ce9-4265-970d-b74eb0d2326f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Request body: {'security_group_rule': {'security_group_id': '238d71da-b989-4fea-9e58-80ca9534d132', 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:25.292617 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-817c1ac8-2ce9-4265-970d-b74eb0d2326f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.347708 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-817c1ac8-2ce9-4265-970d-b74eb0d2326f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.351007 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-817c1ac8-2ce9-4265-970d-b74eb0d2326f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.368962 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-817c1ac8-2ce9-4265-970d-b74eb0d2326f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f7d21635-2bf4-42d5-9985-a89308f2b069,revision_number=0']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:25.380898 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-817c1ac8-2ce9-4265-970d-b74eb0d2326f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.382772 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-817c1ac8-2ce9-4265-970d-b74eb0d2326f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1240363 Nov 21 14:01:25.385605 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59514) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:25.390333 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-d54296d3-6067-470d-ba86-d5553e092496 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Request body: {'security_group_rule': {'security_group_id': '238d71da-b989-4fea-9e58-80ca9534d132', 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:25.416222 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d54296d3-6067-470d-ba86-d5553e092496 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.470900 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d54296d3-6067-470d-ba86-d5553e092496 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.474801 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d54296d3-6067-470d-ba86-d5553e092496 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.493530 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d54296d3-6067-470d-ba86-d5553e092496 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2e264a93-1599-4390-9568-cb2e16cf51a3,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:25.501754 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d54296d3-6067-470d-ba86-d5553e092496 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.502933 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-d54296d3-6067-470d-ba86-d5553e092496 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1163132 Nov 21 14:01:25.505631 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59516) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:25.510545 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-81c561cc-96d4-4c59-9d6c-78f236fc1746 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Request body: {'security_group_rule': {'security_group_id': '238d71da-b989-4fea-9e58-80ca9534d132', 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:25.536201 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-81c561cc-96d4-4c59-9d6c-78f236fc1746 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.591053 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-81c561cc-96d4-4c59-9d6c-78f236fc1746 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.594359 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-81c561cc-96d4-4c59-9d6c-78f236fc1746 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.612067 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81c561cc-96d4-4c59-9d6c-78f236fc1746 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2bb13e44-1a1b-4234-9554-d12d6b5f9897,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:25.620942 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-81c561cc-96d4-4c59-9d6c-78f236fc1746 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.622394 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-81c561cc-96d4-4c59-9d6c-78f236fc1746 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1158607 Nov 21 14:01:25.625061 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59518) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:25.629291 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-ea857172-41c6-4a62-93ee-1e112c7d6306 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Request body: {'security_group_rule': {'security_group_id': '238d71da-b989-4fea-9e58-80ca9534d132', 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:25.649732 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.securitygroups_db [None req-ea857172-41c6-4a62-93ee-1e112c7d6306 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Project db51095fd43e4fe5855207bd0ea7a651 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 21 14:01:25.654468 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ea857172-41c6-4a62-93ee-1e112c7d6306 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.713940 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ea857172-41c6-4a62-93ee-1e112c7d6306 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.717271 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ea857172-41c6-4a62-93ee-1e112c7d6306 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.734934 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea857172-41c6-4a62-93ee-1e112c7d6306 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a306df6f-619c-49a4-ac3b-2dd723813f06,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:25.739639 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ea857172-41c6-4a62-93ee-1e112c7d6306 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.741531 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-ea857172-41c6-4a62-93ee-1e112c7d6306 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1148291 Nov 21 14:01:25.744058 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59520) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:25.748563 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-ce8e7770-e100-4d51-8f73-91b124b1017c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Request body: {'security_group_rule': {'security_group_id': '238d71da-b989-4fea-9e58-80ca9534d132', 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:25.768733 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.securitygroups_db [None req-ce8e7770-e100-4d51-8f73-91b124b1017c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Project db51095fd43e4fe5855207bd0ea7a651 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 21 14:01:25.773351 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ce8e7770-e100-4d51-8f73-91b124b1017c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.831390 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ce8e7770-e100-4d51-8f73-91b124b1017c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.834810 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ce8e7770-e100-4d51-8f73-91b124b1017c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1689682'] for security_group_rule, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.852506 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce8e7770-e100-4d51-8f73-91b124b1017c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3c6c76d5-1856-4e2d-b1a0-ad1141f38385,revision_number=0']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:25.859608 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-ce8e7770-e100-4d51-8f73-91b124b1017c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:25.860854 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-ce8e7770-e100-4d51-8f73-91b124b1017c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1158810 Nov 21 14:01:26.539554 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 1736e9cb-1855-467f-bf4b-333bddef6d70 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:01:26.595255 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 1736e9cb-1855-467f-bf4b-333bddef6d70 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:26.595631 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:26.675885 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:26.700122 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] For port 1736e9cb-1855-467f-bf4b-333bddef6d70, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=1736e9cb-1855-467f-bf4b-333bddef6d70,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:01:26.706471 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:26.765638 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Pushing event updated for resources: {'Port': ['ID=1736e9cb-1855-467f-bf4b-333bddef6d70,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:27.477046 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Sync routers for ids ['a62177be-9f50-4579-8ec7-523c26060526'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 14:01:27.486918 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Routers {'a62177be-9f50-4579-8ec7-523c26060526'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:01:27.487520 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:01:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['a62177be-9f50-4579-8ec7-523c26060526'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:27.596044 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Set router a62177be-9f50-4579-8ec7-523c26060526 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:01:27.794714 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a62177be-9f50-4579-8ec7-523c26060526', 'name': 'tempest-TestVolumeBootPattern-1599347875-router', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49'}], 'enable_snat': True}, 'gw_port_id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:20Z', 'updated_at': '2021-11-21T14:01:23Z', 'revision_number': 4, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'gw_port': {'id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:c1:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:21Z', 'updated_at': '2021-11-21T14:01:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '602b0509-a9ca-469e-ac5d-1511520423f7', 'name': '', 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'mac_address': 'fa:16:3e:d0:ca:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'c1c9af2b-6794-4f3a-a1b2-f58aefe762f8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:23Z', 'updated_at': '2021-11-21T14:01:23Z', 'revision_number': 2, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'subnets': [{'id': 'c1c9af2b-6794-4f3a-a1b2-f58aefe762f8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:27.823570 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Checking router: a62177be-9f50-4579-8ec7-523c26060526 for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 14:01:27.823951 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Updating router a62177be-9f50-4579-8ec7-523c26060526 port 602b0509-a9ca-469e-ac5d-1511520423f7 binding host dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 21 14:01:27.848177 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:28.114693 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Publish callbacks [] for port, precommit_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:28.120876 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:28.179482 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2dd80fd-ace7-4224-b1a9-ffb6f9133c08 None None] Pushing event updated for resources: {'Port': ['ID=602b0509-a9ca-469e-ac5d-1511520423f7,revision_number=3']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:28.321455 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Attempting to bind port 602b0509-a9ca-469e-ac5d-1511520423f7 on host dv-cinder-768458-12-iscsi for vnic_type normal with profile {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 14:01:28.321848 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Attempting to bind port 602b0509-a9ca-469e-ac5d-1511520423f7 by drivers openvswitch,hyperv on host dv-cinder-768458-12-iscsi at level 0 using segments [{'id': '55d0e716-c4c3-4fb4-9184-bc6611b0fac3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2'}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 14:01:28.322209 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Attempting to bind port 602b0509-a9ca-469e-ac5d-1511520423f7 on network 0d56e568-78a2-4494-ad2a-4019474745a2 {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:01:28.327169 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Checking agent: {'id': '45b0e82a-5182-4324-8d27-b3c8bfb307e4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-768458-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 44, 6), 'started_at': datetime.datetime(2021, 11, 21, 13, 44, 36), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 14, 1, 6), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-768458-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 14:01:28.327539 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Checking segment: {'id': '55d0e716-c4c3-4fb4-9184-bc6611b0fac3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109043) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 14:01:28.327965 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:28.328361 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Bound using segment: {'id': '55d0e716-c4c3-4fb4-9184-bc6611b0fac3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2'} {{(pid=109043) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 14:01:28.328817 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.managers [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Bound port: 602b0509-a9ca-469e-ac5d-1511520423f7, host: dv-cinder-768458-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '55d0e716-c4c3-4fb4-9184-bc6611b0fac3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2'}}] {{(pid=109043) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 14:01:28.329197 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:28.388554 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] For port 602b0509-a9ca-469e-ac5d-1511520423f7, host dv-cinder-768458-12-iscsi, cleared binding levels {{(pid=109043) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 14:01:28.391192 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.plugins.ml2.db [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] For port 602b0509-a9ca-469e-ac5d-1511520423f7, host dv-cinder-768458-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=602b0509-a9ca-469e-ac5d-1511520423f7,segment=NetworkSegment(55d0e716-c4c3-4fb4-9184-bc6611b0fac3),segment_id=55d0e716-c4c3-4fb4-9184-bc6611b0fac3)] {{(pid=109043) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 14:01:28.397172 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron_lib.callbacks.manager [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109043) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:28.406283 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-45dd7a5a-1234-4d95-bf04-cffbbbc19d89 None None] Provisioning complete for port 602b0509-a9ca-469e-ac5d-1511520423f7 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:28.406853 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-45dd7a5a-1234-4d95-bf04-cffbbbc19d89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:28.455691 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2dd80fd-ace7-4224-b1a9-ffb6f9133c08 None None] Pushing event updated for resources: {'Port': ['ID=602b0509-a9ca-469e-ac5d-1511520423f7,revision_number=4']} {{(pid=109043) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:28.465831 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Routers {'a62177be-9f50-4579-8ec7-523c26060526'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:01:28.466452 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:01:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['a62177be-9f50-4579-8ec7-523c26060526'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:28.520500 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-45dd7a5a-1234-4d95-bf04-cffbbbc19d89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:28.548474 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 1736e9cb-1855-467f-bf4b-333bddef6d70 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:01:28.584978 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-45dd7a5a-1234-4d95-bf04-cffbbbc19d89 None None] For port 602b0509-a9ca-469e-ac5d-1511520423f7, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=602b0509-a9ca-469e-ac5d-1511520423f7,segment=NetworkSegment(55d0e716-c4c3-4fb4-9184-bc6611b0fac3),segment_id=55d0e716-c4c3-4fb4-9184-bc6611b0fac3)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:01:28.587323 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] Set router a62177be-9f50-4579-8ec7-523c26060526 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:01:28.596114 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-45dd7a5a-1234-4d95-bf04-cffbbbc19d89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:28.659317 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45dd7a5a-1234-4d95-bf04-cffbbbc19d89 None None] Pushing event updated for resources: {'Port': ['ID=602b0509-a9ca-469e-ac5d-1511520423f7,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:28.667922 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 1736e9cb-1855-467f-bf4b-333bddef6d70 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:28.668548 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:28.722640 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-e0d45e70-ede5-40c7-9c30-f34970e31318 None None] Provisioning complete for port 602b0509-a9ca-469e-ac5d-1511520423f7 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:28.722933 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e0d45e70-ede5-40c7-9c30-f34970e31318 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:28.794716 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a62177be-9f50-4579-8ec7-523c26060526', 'name': 'tempest-TestVolumeBootPattern-1599347875-router', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49'}], 'enable_snat': True}, 'gw_port_id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:20Z', 'updated_at': '2021-11-21T14:01:23Z', 'revision_number': 4, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'gw_port': {'id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:c1:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:21Z', 'updated_at': '2021-11-21T14:01:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '602b0509-a9ca-469e-ac5d-1511520423f7', 'name': '', 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'mac_address': 'fa:16:3e:d0:ca:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'c1c9af2b-6794-4f3a-a1b2-f58aefe762f8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:23Z', 'updated_at': '2021-11-21T14:01:28Z', 'revision_number': 4, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'subnets': [{'id': 'c1c9af2b-6794-4f3a-a1b2-f58aefe762f8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:01:28.822775 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29f5a5ec-fb93-40b2-9e67-513a236197ef None None] The sync data for ids ['a62177be-9f50-4579-8ec7-523c26060526'] in dv-cinder-768458-12-iscsi is: [{'id': 'a62177be-9f50-4579-8ec7-523c26060526', 'name': 'tempest-TestVolumeBootPattern-1599347875-router', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49'}], 'enable_snat': True}, 'gw_port_id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:20Z', 'updated_at': '2021-11-21T14:01:23Z', 'revision_number': 4, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'gw_port': {'id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:c1:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:21Z', 'updated_at': '2021-11-21T14:01:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': '602b0509-a9ca-469e-ac5d-1511520423f7', 'name': '', 'network_id': '0d56e568-78a2-4494-ad2a-4019474745a2', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'mac_address': 'fa:16:3e:d0:ca:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'c1c9af2b-6794-4f3a-a1b2-f58aefe762f8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:23Z', 'updated_at': '2021-11-21T14:01:28Z', 'revision_number': 4, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'subnets': [{'id': 'c1c9af2b-6794-4f3a-a1b2-f58aefe762f8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 14:01:30.221529 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-423b4938-b3c8-4ff2-b396-278f7724b56d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:30.545728 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 602b0509-a9ca-469e-ac5d-1511520423f7 up at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:01:30.603360 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Provisioning complete for port 602b0509-a9ca-469e-ac5d-1511520423f7 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:30.603723 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:32.575285 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-3a7ce063-931d-4eac-b60a-b2bcfa899040 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:33.901920 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:35.092022 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:35.605734 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:01:35.870164 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:43.389669 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-aa37c461-ba25-47de-9467-b635a7a3d18b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-847620947&fields=id&tenant_id=db51095fd43e4fe5855207bd0ea7a651 HTTP/1.1" status: 200 len: 267 time: 0.0432785 Nov 21 14:01:43.493787 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-a9b2ab0e-78dc-46b6-8150-104c4ab114dd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:43.495230 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-a9b2ab0e-78dc-46b6-8150-104c4ab114dd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 812 time: 0.0991662 Nov 21 14:01:43.510307 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-5541686d-d55d-487d-87ff-e23426f8735b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/quotas/db51095fd43e4fe5855207bd0ea7a651 HTTP/1.1" status: 200 len: 375 time: 0.0087693 Nov 21 14:01:43.558534 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-6635ff7e-46ed-4e4a-a40b-4be0f5bd8e10 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0432274 Nov 21 14:01:43.654525 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-0f59bb95-104f-471d-9386-1caff048598c service neutron] 10.222.0.11 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840094 Nov 21 14:01:43.740263 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-aa16c708-0268-4659-8870-222fc319e5ec service neutron] 10.222.0.11 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0796347 Nov 21 14:01:44.107763 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5c00f0b6-148f-4a7d-bef8-384f6c1ad057 req-ce997be8-36be-451a-9fa8-c39ab01f4862 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 210 time: 0.1226871 Nov 21 14:01:45.011617 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-5bf6b49f-ac16-4165-9b58-024aebad78f1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:45.013098 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-5bf6b49f-ac16-4165-9b58-024aebad78f1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 812 time: 0.1072567 Nov 21 14:01:45.078210 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-b54f000c-018d-43e6-9eb5-1112a6a2ddda tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=db51095fd43e4fe5855207bd0ea7a651 HTTP/1.1" status: 200 len: 379 time: 0.0541153 Nov 21 14:01:45.087141 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-90960cd1-a272-48bd-add9-d10c8a58d5ac tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Request body: {'port': {'device_id': '9014772b-e240-4c5f-8abc-76aa454938ab', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'admin_state_up': True, 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'security_groups': ['238d71da-b989-4fea-9e58-80ca9534d132']}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:45.211176 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e20c9364-a9c7-45f7-9655-364d385bd6dd req-df2c25c1-42a8-42bd-ba78-4481c7598c95 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 210 time: 0.0347025 Nov 21 14:01:45.229431 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-90960cd1-a272-48bd-add9-d10c8a58d5ac tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Made reservation on behalf of db51095fd43e4fe5855207bd0ea7a651 for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 14:01:45.232943 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-90960cd1-a272-48bd-add9-d10c8a58d5ac tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:45.356854 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-90960cd1-a272-48bd-add9-d10c8a58d5ac tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Allocated IP 172.20.0.6 (4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8/31e0485c-71ee-4ce4-8683-27185a5c5f72/489a10b7-9731-4d59-9d05-a3c042350821) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 14:01:45.501248 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-90960cd1-a272-48bd-add9-d10c8a58d5ac tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:45.534728 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-90960cd1-a272-48bd-add9-d10c8a58d5ac tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:45.586565 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-90960cd1-a272-48bd-add9-d10c8a58d5ac tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:01:45.590291 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-90960cd1-a272-48bd-add9-d10c8a58d5ac tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:01:45.593879 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-90960cd1-a272-48bd-add9-d10c8a58d5ac tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 14:01:45.600108 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90960cd1-a272-48bd-add9-d10c8a58d5ac tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'Port': ['ID=489a10b7-9731-4d59-9d05-a3c042350821,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:45.645588 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-90960cd1-a272-48bd-add9-d10c8a58d5ac tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:45.646166 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-90960cd1-a272-48bd-add9-d10c8a58d5ac tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:45.666865 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-90960cd1-a272-48bd-add9-d10c8a58d5ac tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5832200 Nov 21 14:01:45.683771 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Request body: {'port': {'device_id': '9014772b-e240-4c5f-8abc-76aa454938ab', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:45.737877 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:45.861185 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-912c840a-fc47-4ff6-9ea1-7cd20455395b None None] Provisioning complete for port 489a10b7-9731-4d59-9d05-a3c042350821 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:45.861964 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-912c840a-fc47-4ff6-9ea1-7cd20455395b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:45.896883 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-912c840a-fc47-4ff6-9ea1-7cd20455395b None None] Port 489a10b7-9731-4d59-9d05-a3c042350821 cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 14:01:45.995036 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 489a10b7-9731-4d59-9d05-a3c042350821 {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 14:01:46.002525 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:46.013946 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Transition to ACTIVE for port object 489a10b7-9731-4d59-9d05-a3c042350821 will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 14:01:46.017553 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:46.081064 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Pushing event updated for resources: {'Port': ['ID=489a10b7-9731-4d59-9d05-a3c042350821,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:46.133417 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Attempting to bind port 489a10b7-9731-4d59-9d05-a3c042350821 on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 14:01:46.133764 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Attempting to bind port 489a10b7-9731-4d59-9d05-a3c042350821 by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 14:01:46.134139 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Attempting to bind port 489a10b7-9731-4d59-9d05-a3c042350821 on network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:01:46.138714 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Port 489a10b7-9731-4d59-9d05-a3c042350821 on network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 14:01:46.139043 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Attempting to bind port 489a10b7-9731-4d59-9d05-a3c042350821 on network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:01:46.143936 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 14, 1, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 14:01:46.144285 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Checking segment: {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 14:01:46.144672 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Bound using segment: {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 14:01:46.145104 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Bound port: 489a10b7-9731-4d59-9d05-a3c042350821, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 14:01:46.145461 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:46.222457 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] For port 489a10b7-9731-4d59-9d05-a3c042350821, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 14:01:46.225489 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] For port 489a10b7-9731-4d59-9d05-a3c042350821, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=489a10b7-9731-4d59-9d05-a3c042350821,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 14:01:46.230553 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:46.265288 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:46.265910 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:46.267298 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] 10.222.0.50 "PUT /v2.0/ports/489a10b7-9731-4d59-9d05-a3c042350821 HTTP/1.1" status: 200 len: 1093 time: 0.5878279 Nov 21 14:01:46.267749 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9014772b-e240-4c5f-8abc-76aa454938ab', 'tag': '489a10b7-9731-4d59-9d05-a3c042350821'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:01:46.270068 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f10c0e3-806a-4aef-a9b7-df69a31adab5" -d '{"events": [{"name": "network-changed", "server_uuid": "9014772b-e240-4c5f-8abc-76aa454938ab", "tag": "489a10b7-9731-4d59-9d05-a3c042350821"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:01:46.295036 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12db2afc-a037-4642-9aba-348c8b47e8f4 service neutron] Pushing event updated for resources: {'Port': ['ID=489a10b7-9731-4d59-9d05-a3c042350821,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:46.329182 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 14:01:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-627abb9c-f2a6-4297-9f22-e00f4954d7e2 x-openstack-request-id: req-627abb9c-f2a6-4297-9f22-e00f4954d7e2 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:01:46.329502 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9014772b-e240-4c5f-8abc-76aa454938ab", "tag": "489a10b7-9731-4d59-9d05-a3c042350821", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:01:46.329808 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-627abb9c-f2a6-4297-9f22-e00f4954d7e2 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:01:46.330216 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9014772b-e240-4c5f-8abc-76aa454938ab', 'tag': '489a10b7-9731-4d59-9d05-a3c042350821', 'status': 'completed', 'code': 200} Nov 21 14:01:46.351673 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ec913e8-a912-466a-9960-1b1e691218b1 req-0043109d-faf2-4fa0-9987-9194d8b757e8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:46.353975 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8ec913e8-a912-466a-9960-1b1e691218b1 req-0043109d-faf2-4fa0-9987-9194d8b757e8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 943 time: 0.0605075 Nov 21 14:01:46.365069 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-78d4b019-e7d0-4724-b3b0-f5ec3d07e502 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:46.366572 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-78d4b019-e7d0-4724-b3b0-f5ec3d07e502 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 1096 time: 0.0478063 Nov 21 14:01:46.405889 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8ec913e8-a912-466a-9960-1b1e691218b1 req-93fa1f29-1730-42fb-812b-2ace5d35df9a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451839 Nov 21 14:01:46.412947 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-1d8e6624-0d95-4633-abe2-ac6a0b85dde2 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=489a10b7-9731-4d59-9d05-a3c042350821 HTTP/1.1" status: 200 len: 217 time: 0.0370986 Nov 21 14:01:46.466244 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-b08afa19-b7a7-4819-b450-d5c24b236c41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:46.467738 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-b08afa19-b7a7-4819-b450-d5c24b236c41 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0452447 Nov 21 14:01:46.521729 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-72b49572-6e6f-4058-ba06-c5725ad2fe95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:46.523178 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-72b49572-6e6f-4058-ba06-c5725ad2fe95 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0401971 Nov 21 14:01:46.616900 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-0d041b82-c2c3-4413-a9fb-9323bea5915f service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824797 Nov 21 14:01:46.708046 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c1977e8-204b-42fb-b981-5e8d47d78564 req-46c20c8c-8512-4c0f-a3e4-4da257abcb43 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0797412 Nov 21 14:01:46.805525 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-8a64a55d-2c3a-40ef-a81b-d064677e1688 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:46.807512 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-8a64a55d-2c3a-40ef-a81b-d064677e1688 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 1096 time: 0.0408213 Nov 21 14:01:46.901500 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-7bb6c974-bea9-40f6-a4c8-1591a7ccb111 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:46.902869 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-7bb6c974-bea9-40f6-a4c8-1591a7ccb111 service neutron] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 913 time: 0.0880218 Nov 21 14:01:46.944124 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-caa831b4-f4af-47f5-95a0-dab34b3ecb35 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=489a10b7-9731-4d59-9d05-a3c042350821 HTTP/1.1" status: 200 len: 217 time: 0.0334842 Nov 21 14:01:46.991254 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-8a7d5b60-bd78-495f-b94c-f4f8a5d80904 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:46.992712 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-8a7d5b60-bd78-495f-b94c-f4f8a5d80904 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0411825 Nov 21 14:01:47.041704 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-bec6bb99-e950-4ffd-a918-516956a80a06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:47.043170 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-bec6bb99-e950-4ffd-a918-516956a80a06 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0426655 Nov 21 14:01:47.130705 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-248dce27-4b4d-4c75-a2b3-ce5f3f74a08d service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0793593 Nov 21 14:01:47.224995 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2f10c0e3-806a-4aef-a9b7-df69a31adab5 req-d9d699d1-bef4-4914-8fba-868178cfbd1e service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828230 Nov 21 14:01:47.528416 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd04bcab-1aab-4724-bc24-ea01f050dff0 req-9dfeda8c-200d-4358-b54f-9d2e92a1c759 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:47.529901 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-cd04bcab-1aab-4724-bc24-ea01f050dff0 req-9dfeda8c-200d-4358-b54f-9d2e92a1c759 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 943 time: 0.0544350 Nov 21 14:01:47.577812 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-cd04bcab-1aab-4724-bc24-ea01f050dff0 req-e75d57b8-327e-40b2-a631-75bd0ba592f0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420785 Nov 21 14:01:48.691927 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2acf18e-ae09-4a5d-b223-b55335606d75 req-084fdcc5-7f1f-40e0-b36b-697c3da38e6b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:48.693393 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f2acf18e-ae09-4a5d-b223-b55335606d75 req-084fdcc5-7f1f-40e0-b36b-697c3da38e6b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 943 time: 0.0475106 Nov 21 14:01:48.740327 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f2acf18e-ae09-4a5d-b223-b55335606d75 req-449d62b5-8dee-4f86-932d-7a4819b38ef2 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410030 Nov 21 14:01:49.850746 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cc4efe8-4cdc-4a02-9991-c9d779d75d82 req-93534ca0-fafd-4464-bc0c-13544da22643 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:49.852216 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2cc4efe8-4cdc-4a02-9991-c9d779d75d82 req-93534ca0-fafd-4464-bc0c-13544da22643 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 943 time: 0.0466144 Nov 21 14:01:49.903637 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2cc4efe8-4cdc-4a02-9991-c9d779d75d82 req-28e43597-44aa-4d64-a8df-d6f40cbd4048 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450003 Nov 21 14:01:51.014634 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c051352b-af71-42a4-8fc8-ed60161cebf3 req-80e332d1-082a-4943-bb6a-cb81c2f9922c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:51.016126 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c051352b-af71-42a4-8fc8-ed60161cebf3 req-80e332d1-082a-4943-bb6a-cb81c2f9922c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 943 time: 0.0466945 Nov 21 14:01:51.066929 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c051352b-af71-42a4-8fc8-ed60161cebf3 req-8104847a-ba60-4218-84dc-e0861a60ece4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449142 Nov 21 14:01:52.180166 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95a2e5f-430c-4f1b-a5d7-cb203d0bf264 req-b3fffac3-e086-478b-ac54-bdc1a37c895c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:52.181624 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d95a2e5f-430c-4f1b-a5d7-cb203d0bf264 req-b3fffac3-e086-478b-ac54-bdc1a37c895c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 943 time: 0.0474157 Nov 21 14:01:52.232758 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-d95a2e5f-430c-4f1b-a5d7-cb203d0bf264 req-f770cfcc-68ed-4076-9013-f657bd0ed9fd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453084 Nov 21 14:01:52.648080 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:53.343590 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a8d16dd-723a-4d96-b82d-8a75dafba4e4 req-1da57760-055b-4525-af13-3d3286f2897b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:53.345049 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0a8d16dd-723a-4d96-b82d-8a75dafba4e4 req-1da57760-055b-4525-af13-3d3286f2897b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 943 time: 0.0467947 Nov 21 14:01:53.392600 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-0a8d16dd-723a-4d96-b82d-8a75dafba4e4 req-fab0c1ae-9388-440f-8729-063e4e832615 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417330 Nov 21 14:01:54.503248 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d8e44a-7f1c-47f7-abc5-9281d5c8c624 req-f0e292ab-521f-4cd3-884d-907d7859d063 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:54.504705 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-78d8e44a-7f1c-47f7-abc5-9281d5c8c624 req-f0e292ab-521f-4cd3-884d-907d7859d063 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 943 time: 0.0480163 Nov 21 14:01:54.551882 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-78d8e44a-7f1c-47f7-abc5-9281d5c8c624 req-e8125c40-1563-4df0-ba88-823a786bd5a0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412707 Nov 21 14:01:54.715374 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 489a10b7-9731-4d59-9d05-a3c042350821 details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 14:01:54.806048 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 489a10b7-9731-4d59-9d05-a3c042350821, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=489a10b7-9731-4d59-9d05-a3c042350821,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:01:54.816905 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '489a10b7-9731-4d59-9d05-a3c042350821', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'port_id': '489a10b7-9731-4d59-9d05-a3c042350821', 'mac_address': 'fa:16:3e:76:4d:b9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 542, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 14:01:54.856236 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:54.868283 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 489a10b7-9731-4d59-9d05-a3c042350821 {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 14:01:54.887447 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 489a10b7-9731-4d59-9d05-a3c042350821, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=489a10b7-9731-4d59-9d05-a3c042350821,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:01:54.891969 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:54.937675 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=489a10b7-9731-4d59-9d05-a3c042350821,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:55.146534 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['489a10b7-9731-4d59-9d05-a3c042350821'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 14:01:55.662698 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-113b5676-2c73-486d-b53b-abc38a9ccc46 req-190eb4ac-8ed7-4847-a8a7-e58ff377592c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:55.664862 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-113b5676-2c73-486d-b53b-abc38a9ccc46 req-190eb4ac-8ed7-4847-a8a7-e58ff377592c tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 944 time: 0.0484023 Nov 21 14:01:55.712553 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-113b5676-2c73-486d-b53b-abc38a9ccc46 req-aa4b8dd8-b0c4-4556-ac2e-e3f6c15b8f43 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412507 Nov 21 14:01:56.730797 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 489a10b7-9731-4d59-9d05-a3c042350821 up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:01:56.780318 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port 489a10b7-9731-4d59-9d05-a3c042350821 completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 14:01:56.784489 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 489a10b7-9731-4d59-9d05-a3c042350821 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:01:56.784867 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:56.827547 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7444e3f7-768d-435d-8f36-5bb892685133 req-a6d1a289-d66e-4558-9ebf-8d5659174385 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:56.829023 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7444e3f7-768d-435d-8f36-5bb892685133 req-a6d1a289-d66e-4558-9ebf-8d5659174385 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 944 time: 0.0514562 Nov 21 14:01:56.867728 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:56.880625 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-7444e3f7-768d-435d-8f36-5bb892685133 req-9b3776df-785e-45ba-b08b-caab90c9b008 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458016 Nov 21 14:01:56.892937 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9014772b-e240-4c5f-8abc-76aa454938ab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '489a10b7-9731-4d59-9d05-a3c042350821'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:01:56.895142 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f911da59-8676-4964-9513-248a9589566d" -d '{"events": [{"server_uuid": "9014772b-e240-4c5f-8abc-76aa454938ab", "name": "network-vif-plugged", "status": "completed", "tag": "489a10b7-9731-4d59-9d05-a3c042350821"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:01:56.907585 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 489a10b7-9731-4d59-9d05-a3c042350821, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=489a10b7-9731-4d59-9d05-a3c042350821,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:01:56.911634 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:56.936616 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 14:01:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bf5435e1-2147-4e2b-9625-74aa273e8b8b x-openstack-request-id: req-bf5435e1-2147-4e2b-9625-74aa273e8b8b {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:01:56.936909 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9014772b-e240-4c5f-8abc-76aa454938ab", "name": "network-vif-plugged", "status": "completed", "tag": "489a10b7-9731-4d59-9d05-a3c042350821", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:01:56.937162 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-bf5435e1-2147-4e2b-9625-74aa273e8b8b {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:01:56.937549 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9014772b-e240-4c5f-8abc-76aa454938ab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '489a10b7-9731-4d59-9d05-a3c042350821', 'code': 200} Nov 21 14:01:56.962216 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=489a10b7-9731-4d59-9d05-a3c042350821,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:01:57.163230 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-972e0c77-6221-49d9-81fb-23b0949c1411 req-d3f1160f-f997-4b22-87d8-151af2f056b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:57.164750 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-972e0c77-6221-49d9-81fb-23b0949c1411 req-d3f1160f-f997-4b22-87d8-151af2f056b8 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 1098 time: 0.0441456 Nov 21 14:01:57.210415 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-972e0c77-6221-49d9-81fb-23b0949c1411 req-16e9d621-9cc8-4e51-839e-98b1b34aea88 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0376122 Nov 21 14:01:58.002178 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92acc6ce-6145-4aa4-b60a-f58b7c422843 req-7b1eb7cf-729e-4a10-8726-e125e70f7cc1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:58.003669 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-92acc6ce-6145-4aa4-b60a-f58b7c422843 req-7b1eb7cf-729e-4a10-8726-e125e70f7cc1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 945 time: 0.0519443 Nov 21 14:01:58.051084 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-92acc6ce-6145-4aa4-b60a-f58b7c422843 req-076cf688-26cf-405c-9086-657bfcce43cb tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416632 Nov 21 14:01:59.169059 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd7537fa-5ff7-4c13-9127-c13232d74aad req-4ebb93d0-a89a-497c-83f5-6cea3e1615e7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:59.170505 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-dd7537fa-5ff7-4c13-9127-c13232d74aad req-4ebb93d0-a89a-497c-83f5-6cea3e1615e7 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 945 time: 0.0520036 Nov 21 14:01:59.217490 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-dd7537fa-5ff7-4c13-9127-c13232d74aad req-2c59d9ae-385b-4875-a6fc-476c1ed4b1f3 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411386 Nov 21 14:01:59.328251 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1569b56c-4c51-43af-a2c5-105f92c9fb40 req-611da1fc-9029-41b1-b65c-e4ed0e3e08a2 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:59.329706 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1569b56c-4c51-43af-a2c5-105f92c9fb40 req-611da1fc-9029-41b1-b65c-e4ed0e3e08a2 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 945 time: 0.0476797 Nov 21 14:01:59.377807 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-1569b56c-4c51-43af-a2c5-105f92c9fb40 req-e94061cd-3a83-41ad-8b31-00148d118bb0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421436 Nov 21 14:01:59.399116 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59686) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:59.484165 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd86f77a-c6ef-401f-85c6-8a9913056cb0 tempest-TestVolumeBootPattern-1442637979 tempest-TestVolumeBootPattern-1442637979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:01:59.485656 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-bd86f77a-c6ef-401f-85c6-8a9913056cb0 tempest-TestVolumeBootPattern-1442637979 tempest-TestVolumeBootPattern-1442637979-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 1093 time: 0.0856071 Nov 21 14:01:59.488525 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 59690) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:01:59.492650 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Request body: {'floatingip': {'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'port_id': '489a10b7-9731-4d59-9d05-a3c042350821', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address': '172.20.0.6'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:01:59.514713 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for floatingip, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:59.872108 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:01:59.974057 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Allocated IP 172.27.1.172 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/d412319b-06cc-4413-812a-e450820c58b0) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 14:02:00.070177 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:00.101502 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:00.142351 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:02:00.145088 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:02:00.149244 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 14:02:00.152248 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'Port': ['ID=d412319b-06cc-4413-812a-e450820c58b0,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:02:00.222317 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-bf23e5e6-eda4-4969-ab88-8fdf06794827 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:00.495092 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:00.563878 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:00.708025 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:00.712346 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:00.775595 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'Port': ['ID=d412319b-06cc-4413-812a-e450820c58b0,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:02:00.788615 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:00.896334 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.l3_db [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Floating IP 4aed3a7e-de05-46d8-9441-146e97ca2a5a associated. External IP: 172.27.1.172, port: 489a10b7-9731-4d59-9d05-a3c042350821. Nov 21 14:02:01.097854 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Router 04a22609-002c-4eb7-8a86-c6d6c65e2738 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 14:02:01.203849 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 14:02:01.213384 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db47c4e1-d3b5-4ee7-802a-81647cdd4f4b None None] Sync routers for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 14:02:01.221286 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:01.222695 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db47c4e1-d3b5-4ee7-802a-81647cdd4f4b None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:02:01.223851 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-db47c4e1-d3b5-4ee7-802a-81647cdd4f4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:01:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:02:01.247942 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-0df34f7a-52d7-4de5-8c74-ca24f2c759e0 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.7583659 Nov 21 14:02:01.248620 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9014772b-e240-4c5f-8abc-76aa454938ab', 'tag': '489a10b7-9731-4d59-9d05-a3c042350821'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:02:01.250862 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-729ebdd4-0646-40be-87fc-2b4b244d9e9f" -d '{"events": [{"name": "network-changed", "server_uuid": "9014772b-e240-4c5f-8abc-76aa454938ab", "tag": "489a10b7-9731-4d59-9d05-a3c042350821"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:02:01.291994 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 14:02:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-10a8078e-774d-4f76-b76f-587c20160e27 x-openstack-request-id: req-10a8078e-774d-4f76-b76f-587c20160e27 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:02:01.292320 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9014772b-e240-4c5f-8abc-76aa454938ab", "tag": "489a10b7-9731-4d59-9d05-a3c042350821", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:02:01.292600 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-10a8078e-774d-4f76-b76f-587c20160e27 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:02:01.293004 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9014772b-e240-4c5f-8abc-76aa454938ab', 'tag': '489a10b7-9731-4d59-9d05-a3c042350821', 'status': 'completed', 'code': 200} Nov 21 14:02:01.331602 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-db47c4e1-d3b5-4ee7-802a-81647cdd4f4b None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:02:01.355581 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-be6e6bbd-110f-482b-b086-c4fb95c3aafc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:02:01.357048 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-be6e6bbd-110f-482b-b086-c4fb95c3aafc service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 1098 time: 0.0406530 Nov 21 14:02:01.449743 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-c93a7cab-acda-44b8-b232-a13335865d79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:02:01.451227 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-c93a7cab-acda-44b8-b232-a13335865d79 service neutron] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 913 time: 0.0868757 Nov 21 14:02:01.520119 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-ce120397-6fd4-455b-b667-f39c36d6aa1d service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=489a10b7-9731-4d59-9d05-a3c042350821 HTTP/1.1" status: 200 len: 999 time: 0.0612326 Nov 21 14:02:01.557040 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-db47c4e1-d3b5-4ee7-802a-81647cdd4f4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': '4aed3a7e-de05-46d8-9441-146e97ca2a5a', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.172', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': '489a10b7-9731-4d59-9d05-a3c042350821', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 696, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:76:4d:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9014772b-e240-4c5f-8abc-76aa454938ab', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:02:00Z', 'updated_at': '2021-11-21T14:02:00Z', 'revision_number': 0, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:02:01.570200 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-caed2569-9909-49b6-b670-f63560524280 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:02:01.571721 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-caed2569-9909-49b6-b670-f63560524280 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0434759 Nov 21 14:02:01.586176 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db47c4e1-d3b5-4ee7-802a-81647cdd4f4b None None] Checking router: 04a22609-002c-4eb7-8a86-c6d6c65e2738 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 14:02:01.594440 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db47c4e1-d3b5-4ee7-802a-81647cdd4f4b None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:02:01.595029 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-db47c4e1-d3b5-4ee7-802a-81647cdd4f4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:01:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:02:01.620872 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-a63fb8ff-9e8d-42bf-b0c8-6587adeb55e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:02:01.622563 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-a63fb8ff-9e8d-42bf-b0c8-6587adeb55e6 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0428863 Nov 21 14:02:01.633569 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-ace923d7-1a81-4123-83ce-a3d89f8d268c service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109041) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 14:02:01.634528 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-ace923d7-1a81-4123-83ce-a3d89f8d268c service neutron] 10.222.0.50 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048351 Nov 21 14:02:01.695563 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-db47c4e1-d3b5-4ee7-802a-81647cdd4f4b None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:02:01.721590 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-74169a4a-2dd1-493a-81be-ca282ce686e8 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798078 Nov 21 14:02:01.821329 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-729ebdd4-0646-40be-87fc-2b4b244d9e9f req-34f6fe39-ce6a-4645-8202-7e1b7e0b562b service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0919185 Nov 21 14:02:01.919525 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-db47c4e1-d3b5-4ee7-802a-81647cdd4f4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': '4aed3a7e-de05-46d8-9441-146e97ca2a5a', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.172', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': '489a10b7-9731-4d59-9d05-a3c042350821', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 696, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:76:4d:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9014772b-e240-4c5f-8abc-76aa454938ab', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:02:00Z', 'updated_at': '2021-11-21T14:02:00Z', 'revision_number': 0, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:02:01.943969 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db47c4e1-d3b5-4ee7-802a-81647cdd4f4b None None] The sync data for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi is: [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': '4aed3a7e-de05-46d8-9441-146e97ca2a5a', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.172', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': '489a10b7-9731-4d59-9d05-a3c042350821', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 696, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:76:4d:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9014772b-e240-4c5f-8abc-76aa454938ab', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:02:00Z', 'updated_at': '2021-11-21T14:02:00Z', 'revision_number': 0, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 14:02:02.125942 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-048c7852-4d40-43c4-9023-134326bd81ba None None] New status for floating IP 4aed3a7e-de05-46d8-9441-146e97ca2a5a: ACTIVE {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 14:02:02.575898 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ba2c649c-7af6-4da0-af1e-bf0077d4c9a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:03.903159 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:05.096209 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:05.872730 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:12.604584 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:02:22.668285 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:30.223435 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-51dff086-9352-4170-8c6a-91423a12d2bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:32.580320 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-573b1875-cc58-4346-8c8f-f08fa859888f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:33.907098 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:35.096684 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:35.874153 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:49.602963 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:02:52.687312 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:02:55.913404 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-157e5d5a-d421-44c4-96c5-4497239c122a req-63f7ed56-b577-4500-b327-9e6922eb61b9 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0801454 Nov 21 14:02:56.006192 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-157e5d5a-d421-44c4-96c5-4497239c122a req-2df3bdca-4b22-45eb-8f54-b059e8a633f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:02:56.007632 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-157e5d5a-d421-44c4-96c5-4497239c122a req-2df3bdca-4b22-45eb-8f54-b059e8a633f3 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 1098 time: 0.0402536 Nov 21 14:02:56.114610 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-157e5d5a-d421-44c4-96c5-4497239c122a req-f26bae32-1ec2-46a5-b4c6-ff7f3abacd61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:02:56.116060 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-157e5d5a-d421-44c4-96c5-4497239c122a req-f26bae32-1ec2-46a5-b4c6-ff7f3abacd61 service neutron] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 913 time: 0.0842936 Nov 21 14:02:56.180750 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-157e5d5a-d421-44c4-96c5-4497239c122a req-2080c6ac-a9a6-46cb-937c-94f34fa50227 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=489a10b7-9731-4d59-9d05-a3c042350821 HTTP/1.1" status: 200 len: 1001 time: 0.0553818 Nov 21 14:02:56.230499 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-157e5d5a-d421-44c4-96c5-4497239c122a req-dafc7f43-8eea-4751-945c-a120d542f6b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:02:56.232015 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-157e5d5a-d421-44c4-96c5-4497239c122a req-dafc7f43-8eea-4751-945c-a120d542f6b0 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0425990 Nov 21 14:02:56.282065 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-157e5d5a-d421-44c4-96c5-4497239c122a req-f6e8a5ac-ec9f-4248-8023-951f59bab6c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:02:56.283602 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-157e5d5a-d421-44c4-96c5-4497239c122a req-f6e8a5ac-ec9f-4248-8023-951f59bab6c8 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0420396 Nov 21 14:02:56.376205 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-157e5d5a-d421-44c4-96c5-4497239c122a req-581436c2-1561-470b-917c-ffbb77e5020f service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0807219 Nov 21 14:02:56.473750 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-157e5d5a-d421-44c4-96c5-4497239c122a req-96d841cb-942b-4829-9aef-66df2d03ae72 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851233 Nov 21 14:03:00.224538 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-7ddd19e9-360d-4471-b5c7-4f12ea8e373a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:03:02.580987 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-179410f1-2ea4-41b9-8fd6-a54da6c50068 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:03:03.909785 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:03:05.099142 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:03:05.875726 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:03:22.678549 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:03:26.602131 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:03:30.226043 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-f4221e2a-39de-4052-97fe-be0329273d62 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:03:32.582167 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-edcf4a2a-7c62-4877-b2ed-3927a02f79ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:03:34.031785 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:03:35.103033 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:03:35.876959 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:03:52.678718 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:03:57.826038 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dfd6f1b7-5db7-4d14-aa4c-06fa109ee92a req-614bfb23-4435-4d4b-aac1-d77c4238a056 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0391281 Nov 21 14:03:57.912360 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd6f1b7-5db7-4d14-aa4c-06fa109ee92a req-5af4acb1-4eef-418b-805c-5de5736eb48b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:03:57.913851 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dfd6f1b7-5db7-4d14-aa4c-06fa109ee92a req-5af4acb1-4eef-418b-805c-5de5736eb48b service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 1098 time: 0.0406106 Nov 21 14:03:58.022639 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd6f1b7-5db7-4d14-aa4c-06fa109ee92a req-3451c08b-6e8c-40b8-9fe7-0fc9303b11ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:03:58.024102 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dfd6f1b7-5db7-4d14-aa4c-06fa109ee92a req-3451c08b-6e8c-40b8-9fe7-0fc9303b11ce service neutron] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 913 time: 0.0860913 Nov 21 14:03:58.090006 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dfd6f1b7-5db7-4d14-aa4c-06fa109ee92a req-8671db99-8750-43b1-9aa4-82d9a7fcb731 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=489a10b7-9731-4d59-9d05-a3c042350821 HTTP/1.1" status: 200 len: 1001 time: 0.0552702 Nov 21 14:03:58.142033 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd6f1b7-5db7-4d14-aa4c-06fa109ee92a req-246f30e0-8ef3-4e74-b666-4eb0d5628b3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:03:58.143427 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dfd6f1b7-5db7-4d14-aa4c-06fa109ee92a req-246f30e0-8ef3-4e74-b666-4eb0d5628b3a service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0421336 Nov 21 14:03:58.194993 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd6f1b7-5db7-4d14-aa4c-06fa109ee92a req-a492065d-c74a-4560-8d70-d9bd932753a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:03:58.196464 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dfd6f1b7-5db7-4d14-aa4c-06fa109ee92a req-a492065d-c74a-4560-8d70-d9bd932753a5 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0409679 Nov 21 14:03:58.289930 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dfd6f1b7-5db7-4d14-aa4c-06fa109ee92a req-26ff9aeb-f162-4960-8f8c-e38848080ee6 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814333 Nov 21 14:03:58.380645 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-dfd6f1b7-5db7-4d14-aa4c-06fa109ee92a req-0eca795f-b0d4-4075-8645-b64f38a6bc71 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829625 Nov 21 14:03:58.744655 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d2f41d8-67a8-4065-adab-e63f813bbe4c req-f1cda4fd-e4bd-4354-8702-b218af0f5de1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:03:58.746385 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7d2f41d8-67a8-4065-adab-e63f813bbe4c req-f1cda4fd-e4bd-4354-8702-b218af0f5de1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 945 time: 0.0537765 Nov 21 14:03:58.796922 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-7d2f41d8-67a8-4065-adab-e63f813bbe4c req-cbe6f719-db3e-4f5e-9ed7-4afccc3cf36e tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431111 Nov 21 14:03:59.912604 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-099a0ed7-0395-4696-bc49-40c4621b2a26 req-841fff47-b6cb-4dd2-9c65-0247d42897db tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:03:59.914061 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-099a0ed7-0395-4696-bc49-40c4621b2a26 req-841fff47-b6cb-4dd2-9c65-0247d42897db tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 945 time: 0.0484006 Nov 21 14:03:59.962249 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-099a0ed7-0395-4696-bc49-40c4621b2a26 req-1819bf63-c824-47c5-b7f0-6722462283ca tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416141 Nov 21 14:04:00.227922 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-41b10000-ea58-416d-a898-8511655461ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:00.539508 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-fdc512f7-fbe0-4541-ae69-966932fc9a8e tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:00.541002 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-fdc512f7-fbe0-4541-ae69-966932fc9a8e tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 945 time: 0.0519218 Nov 21 14:04:00.633053 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Deleting port 489a10b7-9731-4d59-9d05-a3c042350821 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:04:00.633389 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:00.717828 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] For port 489a10b7-9731-4d59-9d05-a3c042350821, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=489a10b7-9731-4d59-9d05-a3c042350821,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:04:00.718185 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:00.887794 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:00.888234 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:00.888555 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.db.l3_db [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Floating IP 4aed3a7e-de05-46d8-9441-146e97ca2a5a disassociated. External IP: 172.27.1.172, port: 489a10b7-9731-4d59-9d05-a3c042350821. Nov 21 14:04:00.888897 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling delete_port for 489a10b7-9731-4d59-9d05-a3c042350821 owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:04:01.012908 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:01.047603 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event deleted for resources: {'Port': ['ID=489a10b7-9731-4d59-9d05-a3c042350821,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:04:01.063349 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:01.063702 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:01.064082 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:01.064419 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:01.064755 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:01.065089 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:01.065416 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:01.065875 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:01.066430 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:01.066835 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:01.067231 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:01.067586 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:01.068037 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-04169451-989e-417a-88cb-f50d21744ef9 req-35eb2c84-2e4a-4152-bfa2-7a34be45e2cd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 210 time: 0.0271966 Nov 21 14:04:01.170784 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Router 04a22609-002c-4eb7-8a86-c6d6c65e2738 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 14:04:01.273868 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 14:04:01.284797 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5f5c822-be24-4841-be88-c76e06e57926 None None] Sync routers for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 14:04:01.294328 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5f5c822-be24-4841-be88-c76e06e57926 None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:04:01.295006 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-b5f5c822-be24-4841-be88-c76e06e57926 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:03:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:04:01.315537 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] No DVR routers for this DVR port 489a10b7-9731-4d59-9d05-a3c042350821 on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 14:04:01.318079 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:01.321475 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a5f5b830-4d11-41a0-af20-b6dd6908f282 req-82929a09-2922-48e3-b466-2637d79b3b5a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "DELETE /v2.0/ports/489a10b7-9731-4d59-9d05-a3c042350821 HTTP/1.1" status: 204 len: 173 time: 0.7704022 Nov 21 14:04:01.321912 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9014772b-e240-4c5f-8abc-76aa454938ab', 'name': 'network-vif-deleted', 'tag': '489a10b7-9731-4d59-9d05-a3c042350821'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:04:01.324167 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1ec95263-5a1f-4244-a53b-b3d56643eb71" -d '{"events": [{"server_uuid": "9014772b-e240-4c5f-8abc-76aa454938ab", "name": "network-vif-deleted", "tag": "489a10b7-9731-4d59-9d05-a3c042350821"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:04:01.411072 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-b5f5c822-be24-4841-be88-c76e06e57926 None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:04:01.437469 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 14:04:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9ce3b444-ce00-4173-87f1-dd4104491dbc x-openstack-request-id: req-9ce3b444-ce00-4173-87f1-dd4104491dbc {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:04:01.437771 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9014772b-e240-4c5f-8abc-76aa454938ab", "name": "network-vif-deleted", "tag": "489a10b7-9731-4d59-9d05-a3c042350821", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:04:01.438030 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-9ce3b444-ce00-4173-87f1-dd4104491dbc {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:04:01.438441 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9014772b-e240-4c5f-8abc-76aa454938ab', 'name': 'network-vif-deleted', 'tag': '489a10b7-9731-4d59-9d05-a3c042350821', 'status': 'completed', 'code': 200} Nov 21 14:04:01.615370 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-b5f5c822-be24-4841-be88-c76e06e57926 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:04:01.642381 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5f5c822-be24-4841-be88-c76e06e57926 None None] Checking router: 04a22609-002c-4eb7-8a86-c6d6c65e2738 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 14:04:01.650703 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5f5c822-be24-4841-be88-c76e06e57926 None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:04:01.651255 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-b5f5c822-be24-4841-be88-c76e06e57926 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:03:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:04:01.758877 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-b5f5c822-be24-4841-be88-c76e06e57926 None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:04:01.951519 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-b5f5c822-be24-4841-be88-c76e06e57926 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:04:01.980413 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5f5c822-be24-4841-be88-c76e06e57926 None None] The sync data for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi is: [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 14:04:02.191866 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-43db79c0-8240-431a-8e08-c644f44b4ab9 req-44c0a65a-6d8e-4d80-93e5-363d4f402166 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=9014772b-e240-4c5f-8abc-76aa454938ab HTTP/1.1" status: 200 len: 210 time: 0.0323818 Nov 21 14:04:02.226135 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5428ef3-75da-4b0c-9d4d-70d275d32881 None None] New status for floating IP 4aed3a7e-de05-46d8-9441-146e97ca2a5a: DOWN {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 14:04:02.582491 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-79006306-5c2c-43c9-95f4-8bd6d1efe39f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:03.289568 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 489a10b7-9731-4d59-9d05-a3c042350821 no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 14:04:03.310732 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: 489a10b7-9731-4d59-9d05-a3c042350821 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 14:04:03.311077 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 489a10b7-9731-4d59-9d05-a3c042350821 not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 14:04:03.399951 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-372cd28e-b936-4f67-b502-ea42037c9565 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-847620947&fields=id&tenant_id=db51095fd43e4fe5855207bd0ea7a651 HTTP/1.1" status: 200 len: 267 time: 0.0437415 Nov 21 14:04:03.502918 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-8cb4e0cb-40bd-4837-a98c-6825a7e45c9b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:03.504376 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-8cb4e0cb-40bd-4837-a98c-6825a7e45c9b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 812 time: 0.0977297 Nov 21 14:04:03.519345 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-b5de3fc6-0793-4b6d-a05b-bd642f3f0feb tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/quotas/db51095fd43e4fe5855207bd0ea7a651 HTTP/1.1" status: 200 len: 375 time: 0.0092497 Nov 21 14:04:03.571977 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-981cc92e-2d17-4d63-ba4e-7c05bcf1110a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0476129 Nov 21 14:04:03.601016 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:04:03.629744 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-b557fdde-07eb-4469-832b-02b9455d7113 service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=109040) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 21 14:04:03.630729 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-b557fdde-07eb-4469-832b-02b9455d7113 service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0474973 Nov 21 14:04:03.716402 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-21ea8303-4edd-4742-9beb-84eb4be5da91 service neutron] 10.222.0.11 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0795107 Nov 21 14:04:03.808745 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-b7e13181-389d-4488-a5c6-5a04b11b2e5f service neutron] 10.222.0.11 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857091 Nov 21 14:04:03.918111 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:04.084333 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-91604250-fb35-4cdc-9734-9e9f25db2ca7 req-3118e138-fc30-4b8b-a3be-639ace9ea402 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 210 time: 0.0265410 Nov 21 14:04:05.106918 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:05.190971 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-faebd39c-7291-4652-bf59-167f6b5edf59 req-c74c1419-6d92-4afd-88f6-6ddcd82dcd20 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 210 time: 0.0282066 Nov 21 14:04:05.209604 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-693e7617-89f4-4ad6-8924-a07e046c4c3e tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:05.211050 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-693e7617-89f4-4ad6-8924-a07e046c4c3e tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 812 time: 0.1097322 Nov 21 14:04:05.284355 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-b09bcf60-b62a-4311-83d4-7f98b05dda59 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=db51095fd43e4fe5855207bd0ea7a651 HTTP/1.1" status: 200 len: 379 time: 0.0587254 Nov 21 14:04:05.294434 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-88ee1e9c-6dc9-4357-91d0-7bcfc2955ac1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Request body: {'port': {'device_id': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'admin_state_up': True, 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'security_groups': ['238d71da-b989-4fea-9e58-80ca9534d132']}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:04:05.397475 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-88ee1e9c-6dc9-4357-91d0-7bcfc2955ac1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Made reservation on behalf of db51095fd43e4fe5855207bd0ea7a651 for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 14:04:05.400833 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-88ee1e9c-6dc9-4357-91d0-7bcfc2955ac1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:05.790606 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-88ee1e9c-6dc9-4357-91d0-7bcfc2955ac1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Allocated IP 172.20.0.14 (4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8/31e0485c-71ee-4ce4-8683-27185a5c5f72/cbc8a307-df34-44fb-9201-3c417eda1bd8) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 14:04:05.879693 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:05.927504 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-88ee1e9c-6dc9-4357-91d0-7bcfc2955ac1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:05.959579 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-88ee1e9c-6dc9-4357-91d0-7bcfc2955ac1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:06.003665 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-88ee1e9c-6dc9-4357-91d0-7bcfc2955ac1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:04:06.006955 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-88ee1e9c-6dc9-4357-91d0-7bcfc2955ac1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:04:06.011204 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-88ee1e9c-6dc9-4357-91d0-7bcfc2955ac1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 14:04:06.018386 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ee1e9c-6dc9-4357-91d0-7bcfc2955ac1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'Port': ['ID=cbc8a307-df34-44fb-9201-3c417eda1bd8,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:04:06.065046 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-88ee1e9c-6dc9-4357-91d0-7bcfc2955ac1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:06.065689 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-88ee1e9c-6dc9-4357-91d0-7bcfc2955ac1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:06.081931 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-88ee1e9c-6dc9-4357-91d0-7bcfc2955ac1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7911665 Nov 21 14:04:06.100155 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Request body: {'port': {'device_id': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:04:06.162053 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:06.240971 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-7a7b908e-2e04-443d-b337-a810a4a2f60b None None] Provisioning complete for port cbc8a307-df34-44fb-9201-3c417eda1bd8 triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:04:06.241532 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-7a7b908e-2e04-443d-b337-a810a4a2f60b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:06.277120 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-7a7b908e-2e04-443d-b337-a810a4a2f60b None None] Port cbc8a307-df34-44fb-9201-3c417eda1bd8 cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 14:04:06.366594 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b202d1-f21b-4639-8975-37b8af0cd576 req-91bd1381-1740-4eee-8d06-27c3fe1f6ffc tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:06.368067 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-62b202d1-f21b-4639-8975-37b8af0cd576 req-91bd1381-1740-4eee-8d06-27c3fe1f6ffc tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 932 time: 0.1077116 Nov 21 14:04:06.453076 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-62b202d1-f21b-4639-8975-37b8af0cd576 req-db28e206-bc27-421e-b064-a07002cba4fa tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0780728 Nov 21 14:04:06.491622 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cbc8a307-df34-44fb-9201-3c417eda1bd8 {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 14:04:06.499653 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:06.510945 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Transition to ACTIVE for port object cbc8a307-df34-44fb-9201-3c417eda1bd8 will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 14:04:06.515667 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:06.563621 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Pushing event updated for resources: {'Port': ['ID=cbc8a307-df34-44fb-9201-3c417eda1bd8,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:04:06.637184 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Attempting to bind port cbc8a307-df34-44fb-9201-3c417eda1bd8 on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 14:04:06.637535 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Attempting to bind port cbc8a307-df34-44fb-9201-3c417eda1bd8 by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 14:04:06.637870 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Attempting to bind port cbc8a307-df34-44fb-9201-3c417eda1bd8 on network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:04:06.642566 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Port cbc8a307-df34-44fb-9201-3c417eda1bd8 on network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 14:04:06.642896 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Attempting to bind port cbc8a307-df34-44fb-9201-3c417eda1bd8 on network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:04:06.647789 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 14, 3, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 14:04:06.648158 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Checking segment: {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 14:04:06.648551 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Bound using segment: {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 14:04:06.648985 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Bound port: cbc8a307-df34-44fb-9201-3c417eda1bd8, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 14:04:06.649351 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:06.717662 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] For port cbc8a307-df34-44fb-9201-3c417eda1bd8, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 14:04:06.720664 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] For port cbc8a307-df34-44fb-9201-3c417eda1bd8, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cbc8a307-df34-44fb-9201-3c417eda1bd8,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 14:04:06.725325 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:06.756587 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:06.757208 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:06.758585 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] 10.222.0.50 "PUT /v2.0/ports/cbc8a307-df34-44fb-9201-3c417eda1bd8 HTTP/1.1" status: 200 len: 1094 time: 0.6637664 Nov 21 14:04:06.761237 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'tag': 'cbc8a307-df34-44fb-9201-3c417eda1bd8'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:04:06.764755 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5b901b7b-9983-4812-8faf-3a1d749a7b51" -d '{"events": [{"name": "network-changed", "server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:04:06.813186 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6af5ce2-6902-4593-bca0-4160f7c69702 service neutron] Pushing event updated for resources: {'Port': ['ID=cbc8a307-df34-44fb-9201-3c417eda1bd8,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:04:06.817082 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 14:04:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bb35f210-ae4c-450f-bee2-86cd450a63d8 x-openstack-request-id: req-bb35f210-ae4c-450f-bee2-86cd450a63d8 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:04:06.817382 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:04:06.817648 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-bb35f210-ae4c-450f-bee2-86cd450a63d8 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:04:06.818045 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'tag': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'status': 'completed', 'code': 200} Nov 21 14:04:06.870496 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-b629b71b-0921-4ea4-b898-78897c789563 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:06.872201 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-b629b71b-0921-4ea4-b898-78897c789563 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 1097 time: 0.0439126 Nov 21 14:04:06.927017 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-7f1a0c59-90d9-413c-9fea-98c900f159a3 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cbc8a307-df34-44fb-9201-3c417eda1bd8 HTTP/1.1" status: 200 len: 217 time: 0.0402973 Nov 21 14:04:06.979043 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-6a71e453-d025-4316-a219-d730500ff3a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:06.980433 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-6a71e453-d025-4316-a219-d730500ff3a1 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0429873 Nov 21 14:04:07.031157 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-4449bd0c-f327-4bc9-b361-780d2140d7ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:07.032677 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-4449bd0c-f327-4bc9-b361-780d2140d7ac service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0411055 Nov 21 14:04:07.124713 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-303595f0-26e7-429c-8436-588b8dfce852 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827956 Nov 21 14:04:07.223985 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-40cfadf1-ff99-436a-85b9-512e92eff34f req-eca30a3f-78cb-4111-be44-c1640d1306ae service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889738 Nov 21 14:04:07.319783 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-4237e8d5-4df0-4458-93a7-d79c8434e7c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:07.321280 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-4237e8d5-4df0-4458-93a7-d79c8434e7c0 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 1097 time: 0.0406880 Nov 21 14:04:07.414211 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-2b9e79fa-e562-41e1-81a3-73db76b8f669 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:07.415690 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-2b9e79fa-e562-41e1-81a3-73db76b8f669 service neutron] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 913 time: 0.0851760 Nov 21 14:04:07.458220 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-cb7451c1-4b55-42c4-bbe9-2c8137b3a883 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cbc8a307-df34-44fb-9201-3c417eda1bd8 HTTP/1.1" status: 200 len: 217 time: 0.0337210 Nov 21 14:04:07.511996 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-b8ab7f55-760b-4635-81f4-1ecb29e35882 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:07.514086 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-b8ab7f55-760b-4635-81f4-1ecb29e35882 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0469577 Nov 21 14:04:07.600056 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61860758-465f-4ffb-a070-d055a525d487 req-d1e088d8-b204-4fcd-88be-d992f8544737 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:07.601452 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-61860758-465f-4ffb-a070-d055a525d487 req-d1e088d8-b204-4fcd-88be-d992f8544737 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 944 time: 0.0816925 Nov 21 14:04:07.603933 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-bf23bfbf-d0d4-4cb8-8ed1-7bcd7e915679 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:07.605283 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-bf23bfbf-d0d4-4cb8-8ed1-7bcd7e915679 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0740502 Nov 21 14:04:07.698152 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-61860758-465f-4ffb-a070-d055a525d487 req-a147b55f-b01b-4686-add8-bc03217a45cd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0908816 Nov 21 14:04:07.727897 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-d8ef2675-091d-49d1-943c-97d0db39af85 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1082819 Nov 21 14:04:07.819507 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-5b901b7b-9983-4812-8faf-3a1d749a7b51 req-50986dac-997e-46fb-8841-2fe672ebddaa service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806224 Nov 21 14:04:08.812322 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42841a12-3532-4c47-9f3c-2ee0ab6cbfed req-7dbbc3cc-1f85-452d-97ad-ae2b90ed8317 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:08.813704 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-42841a12-3532-4c47-9f3c-2ee0ab6cbfed req-7dbbc3cc-1f85-452d-97ad-ae2b90ed8317 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 944 time: 0.0484707 Nov 21 14:04:08.863393 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-42841a12-3532-4c47-9f3c-2ee0ab6cbfed req-ecd5cf94-743f-4139-965e-e5ab1a260157 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437677 Nov 21 14:04:09.981755 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a99a68b0-a655-479a-8ec1-27f1818d705c req-013833f2-6709-42c5-9cec-0f93f111edf6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:09.983215 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a99a68b0-a655-479a-8ec1-27f1818d705c req-013833f2-6709-42c5-9cec-0f93f111edf6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 944 time: 0.0519717 Nov 21 14:04:10.031663 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a99a68b0-a655-479a-8ec1-27f1818d705c req-6abee0d7-0496-442e-993d-6307822346f9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420611 Nov 21 14:04:11.149172 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8d1d112-227a-40a2-b6f1-48b63c821849 req-c8add390-0993-4a33-be6f-c1ea66b90517 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:11.150643 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c8d1d112-227a-40a2-b6f1-48b63c821849 req-c8add390-0993-4a33-be6f-c1ea66b90517 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 944 time: 0.0510256 Nov 21 14:04:11.198418 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-c8d1d112-227a-40a2-b6f1-48b63c821849 req-06e63923-0dff-47e8-8f55-764be0ca1611 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414479 Nov 21 14:04:12.453902 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84d32bf-a261-4b72-bb5d-4b872dea4d38 req-f98f3899-4cfb-4416-9488-487116d97eb1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:12.455328 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c84d32bf-a261-4b72-bb5d-4b872dea4d38 req-f98f3899-4cfb-4416-9488-487116d97eb1 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 944 time: 0.0473468 Nov 21 14:04:12.502810 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c84d32bf-a261-4b72-bb5d-4b872dea4d38 req-1bb184b3-bb7c-4e9e-9020-b7d51c48a147 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416503 Nov 21 14:04:13.338596 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device cbc8a307-df34-44fb-9201-3c417eda1bd8 details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 14:04:13.432482 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port cbc8a307-df34-44fb-9201-3c417eda1bd8, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cbc8a307-df34-44fb-9201-3c417eda1bd8,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:04:13.444068 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'port_id': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'mac_address': 'fa:16:3e:a6:15:28', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 542, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 14:04:13.479174 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:13.491189 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cbc8a307-df34-44fb-9201-3c417eda1bd8 {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 14:04:13.510710 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port cbc8a307-df34-44fb-9201-3c417eda1bd8, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cbc8a307-df34-44fb-9201-3c417eda1bd8,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:04:13.514531 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:13.563557 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=cbc8a307-df34-44fb-9201-3c417eda1bd8,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:04:13.570460 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:13.570813 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:13.571156 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:13.571493 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:13.571847 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:13.572186 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:13.572543 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:13.572872 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:13.573205 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:13.573534 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:13.573855 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:13.574178 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:13.614177 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30bb5c89-f948-4ccb-9b57-05d6fa316001 req-c479be9c-c7fc-4f39-8854-f5f49c24b369 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:13.615637 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-30bb5c89-f948-4ccb-9b57-05d6fa316001 req-c479be9c-c7fc-4f39-8854-f5f49c24b369 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 945 time: 0.0483851 Nov 21 14:04:13.663916 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-30bb5c89-f948-4ccb-9b57-05d6fa316001 req-57322589-6935-4ca3-8c50-baf4822ec392 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420175 Nov 21 14:04:13.792443 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['cbc8a307-df34-44fb-9201-3c417eda1bd8'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 14:04:14.780009 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8356c452-2249-4686-a326-3bc694a589a8 req-234634e1-634a-4439-b9fd-404efd6716ae tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:14.782176 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8356c452-2249-4686-a326-3bc694a589a8 req-234634e1-634a-4439-b9fd-404efd6716ae tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 945 time: 0.0529051 Nov 21 14:04:14.831949 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8356c452-2249-4686-a326-3bc694a589a8 req-12c38cbe-0f43-4789-9b8f-faaa300959d3 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425358 Nov 21 14:04:15.354145 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device cbc8a307-df34-44fb-9201-3c417eda1bd8 up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:04:15.401616 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port cbc8a307-df34-44fb-9201-3c417eda1bd8 completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 14:04:15.405984 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port cbc8a307-df34-44fb-9201-3c417eda1bd8 triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:04:15.406355 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:15.478899 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:15.501118 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cbc8a307-df34-44fb-9201-3c417eda1bd8'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:04:15.503409 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7eb0ccb5-2e5b-4f4f-a0e1-218ebf4e82b4" -d '{"events": [{"server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "name": "network-vif-plugged", "status": "completed", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:04:15.519775 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port cbc8a307-df34-44fb-9201-3c417eda1bd8, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cbc8a307-df34-44fb-9201-3c417eda1bd8,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:04:15.524310 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:15.572616 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=cbc8a307-df34-44fb-9201-3c417eda1bd8,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:04:15.610088 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 14:04:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-308ef5b1-c58a-4587-bce6-b5a2256bc9b4 x-openstack-request-id: req-308ef5b1-c58a-4587-bce6-b5a2256bc9b4 {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:04:15.610392 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "name": "network-vif-plugged", "status": "completed", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:04:15.610652 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-308ef5b1-c58a-4587-bce6-b5a2256bc9b4 {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:04:15.611074 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'code': 200} Nov 21 14:04:15.850495 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01666ce2-4716-4b69-b286-985e635eb861 req-e903bf9b-2e21-4b6b-b854-649690f4a28c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:15.851911 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-01666ce2-4716-4b69-b286-985e635eb861 req-e903bf9b-2e21-4b6b-b854-649690f4a28c service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 1099 time: 0.0396430 Nov 21 14:04:15.913072 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-01666ce2-4716-4b69-b286-985e635eb861 req-d526cece-6393-42c7-8994-921be734108a service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0485430 Nov 21 14:04:15.948149 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6289401-a6d2-4972-a756-c2c2d93f7d41 req-ce61cc14-51aa-43b0-9a94-a134e2abdbf5 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:15.949621 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a6289401-a6d2-4972-a756-c2c2d93f7d41 req-ce61cc14-51aa-43b0-9a94-a134e2abdbf5 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 946 time: 0.0486403 Nov 21 14:04:16.001015 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a6289401-a6d2-4972-a756-c2c2d93f7d41 req-2ac81cad-0415-466c-a688-da0edd9648e3 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454404 Nov 21 14:04:17.120285 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f87b4a3f-62f1-45b8-bca0-1f322317d228 req-c5873a15-44ba-4d0d-881b-a327387cefa6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:17.121763 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f87b4a3f-62f1-45b8-bca0-1f322317d228 req-c5873a15-44ba-4d0d-881b-a327387cefa6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 946 time: 0.0515015 Nov 21 14:04:17.175964 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f87b4a3f-62f1-45b8-bca0-1f322317d228 req-330d1a3f-36d8-4092-9508-aac0ff6dd8c3 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466211 Nov 21 14:04:18.287965 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec4a6fef-babb-42c2-b536-23497028e893 req-4a07f1b2-91ca-4723-823c-d2c9e7740ce6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:18.289326 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec4a6fef-babb-42c2-b536-23497028e893 req-4a07f1b2-91ca-4723-823c-d2c9e7740ce6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 946 time: 0.0484846 Nov 21 14:04:18.338791 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ec4a6fef-babb-42c2-b536-23497028e893 req-a14d23ea-fb34-4648-86bc-b5978b243fcc tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436251 Nov 21 14:04:18.449149 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e18fb084-570e-475a-8bbd-8a8e65b9abec req-1e4d176e-7db4-40cb-8785-508b201370ea tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:18.450607 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e18fb084-570e-475a-8bbd-8a8e65b9abec req-1e4d176e-7db4-40cb-8785-508b201370ea tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 946 time: 0.0475905 Nov 21 14:04:18.499740 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-e18fb084-570e-475a-8bbd-8a8e65b9abec req-cbddbecf-b3b0-44d5-9b33-c1c8c4759080 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430992 Nov 21 14:04:18.528872 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59818) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:04:18.567701 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb70d1de-0ecd-4e97-aa13-aadd46caa3d5 tempest-TestVolumeBootPattern-1442637979 tempest-TestVolumeBootPattern-1442637979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:18.569202 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-cb70d1de-0ecd-4e97-aa13-aadd46caa3d5 tempest-TestVolumeBootPattern-1442637979 tempest-TestVolumeBootPattern-1442637979-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 1094 time: 0.0393250 Nov 21 14:04:18.571986 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59820) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:04:18.576143 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Request body: {'floatingip': {'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'port_id': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address': '172.20.0.14'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:04:18.597655 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for floatingip, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:18.693881 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:18.793080 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Allocated IP 172.27.1.148 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/ee661cd4-ef3e-4c64-96b0-f614157d4da2) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 14:04:18.896628 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:18.929251 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:18.968264 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:04:18.972566 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:04:18.976745 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 14:04:18.979678 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'Port': ['ID=ee661cd4-ef3e-4c64-96b0-f614157d4da2,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:04:19.005024 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:19.005378 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:19.005722 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:19.006060 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:19.006394 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:19.006727 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:19.007059 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:19.007388 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:19.007716 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:19.008068 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:19.008394 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:19.008716 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:04:19.331352 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:19.402538 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:19.546320 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:19.550595 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2298230'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:19.618574 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'Port': ['ID=ee661cd4-ef3e-4c64-96b0-f614157d4da2,revision_number=2']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:04:19.630584 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:19.725987 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.l3_db [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Floating IP d2aec114-7c6d-4830-8a52-47153d450a1a associated. External IP: 172.27.1.148, port: cbc8a307-df34-44fb-9201-3c417eda1bd8. Nov 21 14:04:19.927730 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Router 04a22609-002c-4eb7-8a86-c6d6c65e2738 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 14:04:20.027299 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 14:04:20.037748 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b0097f2-3dc5-402f-8722-344886ea614b None None] Sync routers for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 14:04:20.044844 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:20.049016 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b0097f2-3dc5-402f-8722-344886ea614b None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:04:20.049621 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-9b0097f2-3dc5-402f-8722-344886ea614b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:04:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:04:20.073329 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-4fe38c47-fe66-4e6d-8687-8b9d5fe5008d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.5003612 Nov 21 14:04:20.074020 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'tag': 'cbc8a307-df34-44fb-9201-3c417eda1bd8'}] {{(pid=109040) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:04:20.076310 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a0fb9e652e748194bc1d59d499050652e1260aa6f54aa3e041aed7364c74523c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-87dc9c14-77fc-4fb6-a580-1a363e790f3a" -d '{"events": [{"name": "network-changed", "server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8"}]}' {{(pid=109040) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:04:20.159243 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-9b0097f2-3dc5-402f-8722-344886ea614b None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:04:20.173225 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 14:04:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c978d28d-cd19-4f65-b01c-a7dc64fdb6ff x-openstack-request-id: req-c978d28d-cd19-4f65-b01c-a7dc64fdb6ff {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:04:20.173518 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8", "status": "completed", "code": 200}]} {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:04:20.173776 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-c978d28d-cd19-4f65-b01c-a7dc64fdb6ff {{(pid=109040) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:04:20.174182 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'tag': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'status': 'completed', 'code': 200} Nov 21 14:04:20.239508 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-d14d6016-36be-49f6-9d64-c87a33f3d881 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:20.241011 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-d14d6016-36be-49f6-9d64-c87a33f3d881 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 1099 time: 0.0405829 Nov 21 14:04:20.334610 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-edfec2fb-4819-4972-91ed-1a6ccf44a3fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:20.336427 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-edfec2fb-4819-4972-91ed-1a6ccf44a3fc service neutron] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 913 time: 0.0868626 Nov 21 14:04:20.379345 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-9b0097f2-3dc5-402f-8722-344886ea614b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'd2aec114-7c6d-4830-8a52-47153d450a1a', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.148', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:a6:15:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:04:19Z', 'updated_at': '2021-11-21T14:04:19Z', 'revision_number': 0, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:04:20.400735 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-e980b313-5975-49e5-ab67-8f1e7fcf511a service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cbc8a307-df34-44fb-9201-3c417eda1bd8 HTTP/1.1" status: 200 len: 1000 time: 0.0569229 Nov 21 14:04:20.404890 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b0097f2-3dc5-402f-8722-344886ea614b None None] Checking router: 04a22609-002c-4eb7-8a86-c6d6c65e2738 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 14:04:20.414010 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b0097f2-3dc5-402f-8722-344886ea614b None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:04:20.414607 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-9b0097f2-3dc5-402f-8722-344886ea614b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:04:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:04:20.452641 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-4759c04b-86c8-40bc-9956-beb032f94035 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:20.454082 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-4759c04b-86c8-40bc-9956-beb032f94035 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0466437 Nov 21 14:04:20.505206 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-608a629f-83a4-42fe-808c-898fc016fddf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:04:20.506632 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-608a629f-83a4-42fe-808c-898fc016fddf service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0456011 Nov 21 14:04:20.598977 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-ccf30260-a572-4d70-818c-87d7d7a406ff service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844390 Nov 21 14:04:20.637694 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-9b0097f2-3dc5-402f-8722-344886ea614b None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:04:20.691912 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-87dc9c14-77fc-4fb6-a580-1a363e790f3a req-acbb5f1a-dc96-4d5f-9b21-ae85cf8bb01b service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850048 Nov 21 14:04:20.854661 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-9b0097f2-3dc5-402f-8722-344886ea614b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'd2aec114-7c6d-4830-8a52-47153d450a1a', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.148', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:a6:15:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:04:19Z', 'updated_at': '2021-11-21T14:04:19Z', 'revision_number': 0, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:04:20.883671 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b0097f2-3dc5-402f-8722-344886ea614b None None] The sync data for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi is: [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'd2aec114-7c6d-4830-8a52-47153d450a1a', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.148', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:a6:15:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:04:19Z', 'updated_at': '2021-11-21T14:04:19Z', 'revision_number': 0, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 14:04:21.070096 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f080a46-4b0b-4d97-8be8-2f3450d56eb8 None None] New status for floating IP d2aec114-7c6d-4830-8a52-47153d450a1a: ACTIVE {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 14:04:22.693768 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:30.229259 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8bb50f5b-e1dc-4e3e-b4d3-ef13b9645d8f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:32.583175 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c6695ae5-5d6d-4f96-b969-9247527eeec8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:33.922682 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:35.111182 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:35.881316 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:04:40.600525 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:04:52.697053 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:00.230534 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-9aaf62c5-c958-4a01-a952-20b71e93ddcd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:00.665862 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58f5a4f6-944d-4426-8d9b-9cf39bbfdc85 req-d944f2e9-7a15-449c-bbf8-e67941891ec6 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0440495 Nov 21 14:05:00.745467 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58f5a4f6-944d-4426-8d9b-9cf39bbfdc85 req-785552ae-150b-4186-82e5-5145c551c418 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:00.746898 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58f5a4f6-944d-4426-8d9b-9cf39bbfdc85 req-785552ae-150b-4186-82e5-5145c551c418 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 1099 time: 0.0388234 Nov 21 14:05:00.850133 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58f5a4f6-944d-4426-8d9b-9cf39bbfdc85 req-9e2c31b5-e299-4d6e-a93c-93ca11a4a6e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:00.851478 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58f5a4f6-944d-4426-8d9b-9cf39bbfdc85 req-9e2c31b5-e299-4d6e-a93c-93ca11a4a6e9 service neutron] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 913 time: 0.0843315 Nov 21 14:05:00.918950 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58f5a4f6-944d-4426-8d9b-9cf39bbfdc85 req-28d7525b-771f-4902-9282-c3ac5024b396 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cbc8a307-df34-44fb-9201-3c417eda1bd8 HTTP/1.1" status: 200 len: 1002 time: 0.0596924 Nov 21 14:05:00.966812 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58f5a4f6-944d-4426-8d9b-9cf39bbfdc85 req-6aadfe04-4c4a-4ae8-9e21-c41cba8df86b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:00.968220 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58f5a4f6-944d-4426-8d9b-9cf39bbfdc85 req-6aadfe04-4c4a-4ae8-9e21-c41cba8df86b service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0417860 Nov 21 14:05:01.020113 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58f5a4f6-944d-4426-8d9b-9cf39bbfdc85 req-475b789a-7840-4fa4-8b5d-f7fb99aa9db3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:01.021542 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58f5a4f6-944d-4426-8d9b-9cf39bbfdc85 req-475b789a-7840-4fa4-8b5d-f7fb99aa9db3 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0421073 Nov 21 14:05:01.108513 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58f5a4f6-944d-4426-8d9b-9cf39bbfdc85 req-5105acc3-714d-4038-94ab-60383d126d41 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0782259 Nov 21 14:05:01.202875 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58f5a4f6-944d-4426-8d9b-9cf39bbfdc85 req-97ce0028-b0bb-466f-809c-c0ea7ac9461a service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825522 Nov 21 14:05:02.584038 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-9a9a89d0-ddff-4d5f-8945-469295c47da9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:03.922683 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:05.112107 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:05.882467 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:17.599649 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:05:22.690715 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:30.231122 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-9ebcd35e-4a2d-4d7c-9318-345803439f94 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:32.587644 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5bbd987e-c1bc-4557-8291-8a2c28dccb24 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:33.925420 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:35.116887 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:35.884187 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:52.705885 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:54.600840 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:05:55.389350 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-a82b078f-a33b-4cdc-b580-e6e9fbddbb1f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-847620947&fields=id&tenant_id=db51095fd43e4fe5855207bd0ea7a651 HTTP/1.1" status: 200 len: 267 time: 0.0456882 Nov 21 14:05:55.491871 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-205a591a-d8a0-4a39-8bc9-2a5ddad5ce38 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:55.493289 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-205a591a-d8a0-4a39-8bc9-2a5ddad5ce38 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 812 time: 0.0974560 Nov 21 14:05:55.508406 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-da27d11c-4ff8-42e1-9f52-662c1cf8c8d9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/quotas/db51095fd43e4fe5855207bd0ea7a651 HTTP/1.1" status: 200 len: 375 time: 0.0092335 Nov 21 14:05:55.562213 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-4fc57c1e-1f17-4421-9187-bda564408365 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0487821 Nov 21 14:05:55.655229 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-bac38352-3972-427c-b35d-34950e769bd0 service neutron] 10.222.0.11 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0803082 Nov 21 14:05:55.745357 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-a94222c7-7652-4997-a1a2-6f8ae36cc5f6 service neutron] 10.222.0.11 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835195 Nov 21 14:05:56.024246 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-94eba4ca-0a17-47de-8a6a-8a2fb5cac4b8 req-b3865fbf-2761-44ef-a84b-18cffc4bebc8 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 210 time: 0.0269699 Nov 21 14:05:57.129774 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-baafd677-2a91-4cb2-8a19-0474b2cd8489 req-16ea0bb7-6bcd-437a-be30-c8705742d937 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 210 time: 0.0286388 Nov 21 14:05:57.273770 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-468a556f-485b-4463-a615-35bb30659f25 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:57.275238 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-468a556f-485b-4463-a615-35bb30659f25 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 812 time: 0.1029623 Nov 21 14:05:57.341390 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-f81f7655-2d7d-4ce1-9252-3cbde5a16396 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=db51095fd43e4fe5855207bd0ea7a651 HTTP/1.1" status: 200 len: 379 time: 0.0538104 Nov 21 14:05:57.353166 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Request body: {'port': {'device_id': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'admin_state_up': True, 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'security_groups': ['238d71da-b989-4fea-9e58-80ca9534d132']}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:05:57.457887 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Made reservation on behalf of db51095fd43e4fe5855207bd0ea7a651 for: {'port': 1} {{(pid=109041) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 21 14:05:57.465220 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:57.587233 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_common [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Allocated IP 172.20.0.12 (4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8/31e0485c-71ee-4ce4-8683-27185a5c5f72/549d8b87-c3cf-4a17-bfa0-15421b9689ff) {{(pid=109041) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 14:05:57.726480 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for port, precommit_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:57.759516 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_create {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:57.807337 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 is already hosted by enough agents. {{(pid=109041) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:05:57.810772 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.base_scheduler [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Resources bound (agent type, host, resource id): {{(pid=109041) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:05:57.814451 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Received port after_create {{(pid=109041) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 14:05:57.840737 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'Port': ['ID=549d8b87-c3cf-4a17-bfa0-15421b9689ff,revision_number=1']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:05:57.849960 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:05:57.850310 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:05:57.851104 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:05:57.851104 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:05:57.851345 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:05:57.851601 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:05:57.851956 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:05:57.852283 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:05:57.852606 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:05:57.852928 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:05:57.853250 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:05:57.853567 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:05:57.884495 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:57.884836 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:57.900441 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-6e1ee9cc-b2b8-4471-aab9-ea95ff380f57 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5507581 Nov 21 14:05:57.913227 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.v2.base [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Request body: {'port': {'device_id': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76845'}} {{(pid=109041) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:05:57.975190 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:58.073622 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-4fb5bc78-d38b-4428-86c5-dfc8b7b12507 None None] Provisioning complete for port 549d8b87-c3cf-4a17-bfa0-15421b9689ff triggered by entity DHCP. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:05:58.074283 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-4fb5bc78-d38b-4428-86c5-dfc8b7b12507 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:58.110905 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-4fb5bc78-d38b-4428-86c5-dfc8b7b12507 None None] Port 549d8b87-c3cf-4a17-bfa0-15421b9689ff cannot update to ACTIVE because it is not bound. {{(pid=109042) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 21 14:05:58.257609 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 549d8b87-c3cf-4a17-bfa0-15421b9689ff {{(pid=109041) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 14:05:58.267076 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Publish callbacks [] for port, precommit_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:58.277634 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8920ce2a-fa9d-4a5f-8c75-0da4f9aef1fb req-968bfa65-0d60-42a5-97ed-c1a18ff0811d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:58.279108 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8920ce2a-fa9d-4a5f-8c75-0da4f9aef1fb req-968bfa65-0d60-42a5-97ed-c1a18ff0811d tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 932 time: 0.0823100 Nov 21 14:05:58.293840 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.provisioning_blocks [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Transition to ACTIVE for port object 549d8b87-c3cf-4a17-bfa0-15421b9689ff will not be triggered until provisioned by entity L2. {{(pid=109041) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 21 14:05:58.305173 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:58.373281 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Pushing event updated for resources: {'Port': ['ID=549d8b87-c3cf-4a17-bfa0-15421b9689ff,revision_number=2']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:05:58.381290 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8920ce2a-fa9d-4a5f-8c75-0da4f9aef1fb req-aebc10e3-7190-42be-a9cb-4a7628711485 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0944819 Nov 21 14:05:58.451130 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Attempting to bind port 549d8b87-c3cf-4a17-bfa0-15421b9689ff on host hv-cinder-76845 for vnic_type normal with profile {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 21 14:05:58.451468 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Attempting to bind port 549d8b87-c3cf-4a17-bfa0-15421b9689ff by drivers openvswitch,hyperv on host hv-cinder-76845 at level 0 using segments [{'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 21 14:05:58.451799 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Attempting to bind port 549d8b87-c3cf-4a17-bfa0-15421b9689ff on network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:05:58.456774 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Port 549d8b87-c3cf-4a17-bfa0-15421b9689ff on network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76845 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 21 14:05:58.457098 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Attempting to bind port 549d8b87-c3cf-4a17-bfa0-15421b9689ff on network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 21 14:05:58.462030 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Checking agent: {'id': 'a0a398c1-e009-4ab9-beb9-c33310cf56c0', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76845', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'started_at': datetime.datetime(2021, 11, 21, 13, 49, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 21, 14, 5, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 21 14:05:58.462366 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Checking segment: {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109041) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 21 14:05:58.462751 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Bound using segment: {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'} {{(pid=109041) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 21 14:05:58.463175 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.managers [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Bound port: 549d8b87-c3cf-4a17-bfa0-15421b9689ff, host: hv-cinder-76845, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2f57cdde-a3c9-40c0-88f0-211e71097d2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8'}}] {{(pid=109041) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 21 14:05:58.463532 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:58.530758 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] For port 549d8b87-c3cf-4a17-bfa0-15421b9689ff, host hv-cinder-76845, cleared binding levels {{(pid=109041) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 21 14:05:58.534386 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] For port 549d8b87-c3cf-4a17-bfa0-15421b9689ff, host hv-cinder-76845, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=549d8b87-c3cf-4a17-bfa0-15421b9689ff,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109041) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 21 14:05:58.538716 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3087062'] for port, after_update {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:58.573963 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:58.574594 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:05:58.575994 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] 10.222.0.50 "PUT /v2.0/ports/549d8b87-c3cf-4a17-bfa0-15421b9689ff HTTP/1.1" status: 200 len: 1094 time: 0.6669936 Nov 21 14:05:58.576433 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'tag': '549d8b87-c3cf-4a17-bfa0-15421b9689ff'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:05:58.579199 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96" -d '{"events": [{"name": "network-changed", "server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:05:58.601095 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-243d93a2-a153-4f6a-a0aa-54097ce91aee service neutron] Pushing event updated for resources: {'Port': ['ID=549d8b87-c3cf-4a17-bfa0-15421b9689ff,revision_number=3']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:05:58.624918 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 14:05:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c0724e9-09b4-4aa3-8381-53a25a1e98e9 x-openstack-request-id: req-4c0724e9-09b4-4aa3-8381-53a25a1e98e9 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:05:58.625817 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:05:58.626077 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-4c0724e9-09b4-4aa3-8381-53a25a1e98e9 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:05:58.626488 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'tag': '549d8b87-c3cf-4a17-bfa0-15421b9689ff', 'status': 'completed', 'code': 200} Nov 21 14:05:58.676384 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-c857c9b0-03a7-4873-829f-ff509b705fb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:58.677909 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-c857c9b0-03a7-4873-829f-ff509b705fb6 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 1097 time: 0.0424471 Nov 21 14:05:58.728403 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-310c123a-905f-4f3f-8c4f-8ad068412ec6 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=549d8b87-c3cf-4a17-bfa0-15421b9689ff HTTP/1.1" status: 200 len: 217 time: 0.0378542 Nov 21 14:05:58.778170 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-e9f5325c-f1da-46cd-b6dc-695d0f6285b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:58.779643 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-e9f5325c-f1da-46cd-b6dc-695d0f6285b6 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0437379 Nov 21 14:05:58.828701 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-f2fa5c63-e6b8-4181-b585-3153c86bb903 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:58.830109 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-f2fa5c63-e6b8-4181-b585-3153c86bb903 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0386486 Nov 21 14:05:58.928666 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-fbb3ca3b-afe4-4d08-8d2a-2437062225ec service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867636 Nov 21 14:05:59.022268 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3da6d8d4-2d53-4a39-b8b4-963c04421e11 req-51a79250-ed40-47f1-88dd-63b09e0b0fe0 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818462 Nov 21 14:05:59.115799 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-50356a98-a94f-4cb5-a573-a48e4e7357fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:59.117324 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-50356a98-a94f-4cb5-a573-a48e4e7357fe service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 1097 time: 0.0397890 Nov 21 14:05:59.210436 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-112bc780-1a83-497f-84a0-c4396441543e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:59.211768 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-112bc780-1a83-497f-84a0-c4396441543e service neutron] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 913 time: 0.0843065 Nov 21 14:05:59.256646 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-ddbe3be0-e329-4dc1-b056-fc92df05e7cc service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=549d8b87-c3cf-4a17-bfa0-15421b9689ff HTTP/1.1" status: 200 len: 217 time: 0.0332618 Nov 21 14:05:59.304794 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-95c7359c-6e6f-4175-888b-6964ba8cfac5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:59.306206 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-95c7359c-6e6f-4175-888b-6964ba8cfac5 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0419419 Nov 21 14:05:59.354864 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-2f9a686c-acba-4aea-9e6f-a08d837e7507 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:59.356328 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-2f9a686c-acba-4aea-9e6f-a08d837e7507 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0422678 Nov 21 14:05:59.446078 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-fb5f4c5b-2b13-4e08-9ea1-b0abce963ea8 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0806279 Nov 21 14:05:59.552152 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e762caf-9eca-4615-a67e-c05aa77d4c53 req-d57bd633-01a1-4983-a843-610481108242 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:59.553605 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4e762caf-9eca-4615-a67e-c05aa77d4c53 req-d57bd633-01a1-4983-a843-610481108242 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 944 time: 0.0986280 Nov 21 14:05:59.596131 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-58e6de6e-1a4e-42e6-aaec-79d9b04faa96 req-630da4c6-1c5a-4931-9262-0c2711024538 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1329238 Nov 21 14:05:59.622360 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-4e762caf-9eca-4615-a67e-c05aa77d4c53 req-9f326412-49e7-4953-a791-66418386838a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0584023 Nov 21 14:05:59.858438 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-db4f6d11-63d6-4419-bdd3-221ca3dffafc req-fb89ad15-6851-4631-a21d-b629ba3fe857 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0407999 Nov 21 14:05:59.950671 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4f6d11-63d6-4419-bdd3-221ca3dffafc req-8d1e6a6b-c485-41df-9ae3-1698bc942c1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:05:59.952187 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-db4f6d11-63d6-4419-bdd3-221ca3dffafc req-8d1e6a6b-c485-41df-9ae3-1698bc942c1d service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 1099 time: 0.0391769 Nov 21 14:06:00.059736 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4f6d11-63d6-4419-bdd3-221ca3dffafc req-1ad708df-4fba-4a5b-a756-e1862ee37df8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:00.061201 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-db4f6d11-63d6-4419-bdd3-221ca3dffafc req-1ad708df-4fba-4a5b-a756-e1862ee37df8 service neutron] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 913 time: 0.0828435 Nov 21 14:06:00.132538 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-db4f6d11-63d6-4419-bdd3-221ca3dffafc req-92a69008-9535-4bed-884a-67c3a71adacf service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cbc8a307-df34-44fb-9201-3c417eda1bd8 HTTP/1.1" status: 200 len: 1002 time: 0.0595047 Nov 21 14:06:00.183630 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4f6d11-63d6-4419-bdd3-221ca3dffafc req-05dba898-7dda-42d9-9599-c51e308b035c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:00.185021 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-db4f6d11-63d6-4419-bdd3-221ca3dffafc req-05dba898-7dda-42d9-9599-c51e308b035c service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0418859 Nov 21 14:06:00.231003 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-480877e8-3a74-468d-b3ce-d6551a708833 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:00.233001 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4f6d11-63d6-4419-bdd3-221ca3dffafc req-2e6dfe67-659d-47af-86f5-4551875d63ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:00.235046 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-db4f6d11-63d6-4419-bdd3-221ca3dffafc req-2e6dfe67-659d-47af-86f5-4551875d63ac service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0384085 Nov 21 14:06:00.327550 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-db4f6d11-63d6-4419-bdd3-221ca3dffafc req-1b8f5549-83b9-482e-b238-d65f0b436641 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826147 Nov 21 14:06:00.419353 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-db4f6d11-63d6-4419-bdd3-221ca3dffafc req-6c6319af-02a8-47ff-8092-3069ebd67fac service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0797193 Nov 21 14:06:00.738444 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3780de7f-e00f-4a45-8927-bec12b2f939c req-4a00f7f5-6cab-4d24-acd8-db4817703412 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:00.739823 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3780de7f-e00f-4a45-8927-bec12b2f939c req-4a00f7f5-6cab-4d24-acd8-db4817703412 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 944 time: 0.0483401 Nov 21 14:06:00.788088 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-3780de7f-e00f-4a45-8927-bec12b2f939c req-d71f3353-52fd-4bae-a3c8-e737938744fa tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421062 Nov 21 14:06:01.902127 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e307a2e1-5059-4c8a-9dff-a12997f6216b req-6da13a4a-8906-476d-9a63-850dafc49711 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:01.903554 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e307a2e1-5059-4c8a-9dff-a12997f6216b req-6da13a4a-8906-476d-9a63-850dafc49711 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 944 time: 0.0484059 Nov 21 14:06:01.955077 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e307a2e1-5059-4c8a-9dff-a12997f6216b req-b9c5e237-5558-475e-9a6d-0b034528ec31 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451434 Nov 21 14:06:02.588035 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-bb4c6b30-948e-4a26-80d8-26adaa0345e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:03.070283 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f5f635-6aff-4612-ae7c-8bf512ff8503 req-5b1877c1-ca2c-4771-a817-e3a2cc539ece tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:03.071731 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f0f5f635-6aff-4612-ae7c-8bf512ff8503 req-5b1877c1-ca2c-4771-a817-e3a2cc539ece tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 944 time: 0.0510256 Nov 21 14:06:03.119740 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-f0f5f635-6aff-4612-ae7c-8bf512ff8503 req-3162605e-e206-4484-ad8e-d2517d8e82e2 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421669 Nov 21 14:06:03.926482 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:04.234789 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8f561ff-9362-4006-8e3a-a3fbc6519990 req-b170a048-d1b8-40ba-bc86-835c39671efb tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:04.236178 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f8f561ff-9362-4006-8e3a-a3fbc6519990 req-b170a048-d1b8-40ba-bc86-835c39671efb tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 944 time: 0.0473475 Nov 21 14:06:04.284679 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-f8f561ff-9362-4006-8e3a-a3fbc6519990 req-843b5e6f-275d-44ba-bba2-923fcaf7a4ff tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427334 Nov 21 14:06:05.121052 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:05.395053 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ad6c1d-e168-4873-9e3f-abca24a6e7e0 req-f729b16e-b8ba-464b-bbf8-ee2ed41279d5 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:05.396441 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d4ad6c1d-e168-4873-9e3f-abca24a6e7e0 req-f729b16e-b8ba-464b-bbf8-ee2ed41279d5 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 944 time: 0.0472615 Nov 21 14:06:05.443823 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-d4ad6c1d-e168-4873-9e3f-abca24a6e7e0 req-551428db-d41e-4ae5-ac8f-da4a2ceba388 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415804 Nov 21 14:06:05.886277 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:06.554814 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55738a00-d672-4e2b-9d74-0962c019e082 req-20b718d6-d287-44e7-bba7-b62e80ef8b35 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:06.556163 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-55738a00-d672-4e2b-9d74-0962c019e082 req-20b718d6-d287-44e7-bba7-b62e80ef8b35 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 944 time: 0.0467513 Nov 21 14:06:06.602978 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-55738a00-d672-4e2b-9d74-0962c019e082 req-81fb874c-160e-496a-98be-3540a8e2a3fb tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410550 Nov 21 14:06:07.715180 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9717eac0-94d7-46e1-b1a5-552dd6cc3286 req-06eaec32-daee-46e4-9b1c-30584b7a012a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:07.716685 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-9717eac0-94d7-46e1-b1a5-552dd6cc3286 req-06eaec32-daee-46e4-9b1c-30584b7a012a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 944 time: 0.0477941 Nov 21 14:06:07.768092 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-9717eac0-94d7-46e1-b1a5-552dd6cc3286 req-acdaad90-5a01-4f07-ad04-651ffa65e03a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448575 Nov 21 14:06:08.021354 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 549d8b87-c3cf-4a17-bfa0-15421b9689ff details requested by agent hyperv_hv-cinder-76845 with host hv-cinder-76845 {{(pid=109042) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 21 14:06:08.110970 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 549d8b87-c3cf-4a17-bfa0-15421b9689ff, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=549d8b87-c3cf-4a17-bfa0-15421b9689ff,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:06:08.122371 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Returning: {'device': '549d8b87-c3cf-4a17-bfa0-15421b9689ff', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'port_id': '549d8b87-c3cf-4a17-bfa0-15421b9689ff', 'mac_address': 'fa:16:3e:d3:b6:28', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 542, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109042) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 21 14:06:08.159215 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:08.174590 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 549d8b87-c3cf-4a17-bfa0-15421b9689ff {{(pid=109042) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 21 14:06:08.193123 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 549d8b87-c3cf-4a17-bfa0-15421b9689ff, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=549d8b87-c3cf-4a17-bfa0-15421b9689ff,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:06:08.197159 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:08.242609 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=549d8b87-c3cf-4a17-bfa0-15421b9689ff,revision_number=4']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:06:08.249578 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:08.250510 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:08.250859 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:08.251196 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:08.251530 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:08.251885 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:08.252218 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:08.252551 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:08.252881 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:08.253207 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:08.253530 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:08.253854 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:08.467962 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] get_ports_and_sgs() called for port_ids ['549d8b87-c3cf-4a17-bfa0-15421b9689ff'] {{(pid=109042) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 21 14:06:09.143131 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b1736db-1696-4025-856a-ac628d41e630 req-27bc1e5d-bed6-4580-82c7-12dda75c8eb6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:09.144608 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3b1736db-1696-4025-856a-ac628d41e630 req-27bc1e5d-bed6-4580-82c7-12dda75c8eb6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 945 time: 0.3121321 Nov 21 14:06:09.192426 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-3b1736db-1696-4025-856a-ac628d41e630 req-724bba86-5fd3-4c53-bad2-53273ca87fce tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419898 Nov 21 14:06:10.028034 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 549d8b87-c3cf-4a17-bfa0-15421b9689ff up at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 21 14:06:10.075011 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning for port 549d8b87-c3cf-4a17-bfa0-15421b9689ff completed by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 21 14:06:10.078857 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.provisioning_blocks [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Provisioning complete for port 549d8b87-c3cf-4a17-bfa0-15421b9689ff triggered by entity L2. {{(pid=109042) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 21 14:06:10.079234 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-635753'] for port, provisioning_complete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:10.154835 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:10.176956 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '549d8b87-c3cf-4a17-bfa0-15421b9689ff'}] {{(pid=109042) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:06:10.179180 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8d78691c032d21fcf7168e47cb4536365d804ee29280352b141cdec9c7bbad43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8cf547cc-c02d-46b1-9133-43da6fd5f53a" -d '{"events": [{"server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "name": "network-vif-plugged", "status": "completed", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff"}]}' {{(pid=109042) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:06:10.191947 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] For port 549d8b87-c3cf-4a17-bfa0-15421b9689ff, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=549d8b87-c3cf-4a17-bfa0-15421b9689ff,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:06:10.196644 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882'] for port, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:10.223843 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 14:06:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f7e31416-7380-431d-8489-764e4937514d x-openstack-request-id: req-f7e31416-7380-431d-8489-764e4937514d {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:06:10.224143 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "name": "network-vif-plugged", "status": "completed", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff", "code": 200}]} {{(pid=109042) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:06:10.224401 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-f7e31416-7380-431d-8489-764e4937514d {{(pid=109042) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:06:10.224796 dv-cinder-768458-12-iscsi neutron-server[109042]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '549d8b87-c3cf-4a17-bfa0-15421b9689ff', 'code': 200} Nov 21 14:06:10.249217 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Pushing event updated for resources: {'Port': ['ID=549d8b87-c3cf-4a17-bfa0-15421b9689ff,revision_number=5']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:06:10.312067 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca1218dd-fafb-41ec-9cfd-23b9296019ca req-32f722e2-2189-4434-a205-e43dc2c002de tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:10.313569 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ca1218dd-fafb-41ec-9cfd-23b9296019ca req-32f722e2-2189-4434-a205-e43dc2c002de tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 946 time: 0.0479624 Nov 21 14:06:10.364237 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-ca1218dd-fafb-41ec-9cfd-23b9296019ca req-c0074ec8-bd31-4f89-ae09-83e12794b56b tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447333 Nov 21 14:06:10.436171 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8afb4fc6-9ad2-4d6f-b8a5-6fef104c4d73 req-83ea357c-ac90-418b-9ea8-a798eb4e5aa9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:10.437588 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8afb4fc6-9ad2-4d6f-b8a5-6fef104c4d73 req-83ea357c-ac90-418b-9ea8-a798eb4e5aa9 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 1099 time: 0.0388823 Nov 21 14:06:10.485855 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-8afb4fc6-9ad2-4d6f-b8a5-6fef104c4d73 req-474b23ce-26b8-4faf-8e82-9e47fdf28d23 service neutron] 10.222.0.50 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405467 Nov 21 14:06:11.484586 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e4bffd-3ec5-498b-82b1-38f5090eab8f req-a7e1fe69-dbc7-4e92-ac83-9fb6d806f768 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:11.486102 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-62e4bffd-3ec5-498b-82b1-38f5090eab8f req-a7e1fe69-dbc7-4e92-ac83-9fb6d806f768 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 946 time: 0.0506153 Nov 21 14:06:11.543379 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-62e4bffd-3ec5-498b-82b1-38f5090eab8f req-9f8794ef-74a3-49af-a709-0c3a7609a8df tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0505686 Nov 21 14:06:12.653782 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30e52cd5-f57d-4e02-a613-33097f6d4727 req-09e99631-db88-4450-92d7-b355f4495ef5 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:12.655207 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-30e52cd5-f57d-4e02-a613-33097f6d4727 req-09e99631-db88-4450-92d7-b355f4495ef5 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 946 time: 0.0472307 Nov 21 14:06:12.701747 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-30e52cd5-f57d-4e02-a613-33097f6d4727 req-679d9b7d-1322-4ed8-ba6e-565dd9e285b9 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407782 Nov 21 14:06:12.812152 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8043cae3-4038-48a3-b0ed-9eb9a700e6f7 req-b06cd465-c3e6-4fb1-92cb-42e995b4efcd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:12.814208 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8043cae3-4038-48a3-b0ed-9eb9a700e6f7 req-b06cd465-c3e6-4fb1-92cb-42e995b4efcd tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 946 time: 0.0472460 Nov 21 14:06:12.861021 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-8043cae3-4038-48a3-b0ed-9eb9a700e6f7 req-42939f35-dc2f-4e88-b56f-b7f6a99516ea tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409315 Nov 21 14:06:12.883140 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59940) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:06:13.145684 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-396ff3c6-415d-4bf5-978d-d46d3d595619 tempest-TestVolumeBootPattern-1442637979 tempest-TestVolumeBootPattern-1442637979-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:13.147105 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-396ff3c6-415d-4bf5-978d-d46d3d595619 tempest-TestVolumeBootPattern-1442637979 tempest-TestVolumeBootPattern-1442637979-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 1094 time: 0.2630136 Nov 21 14:06:13.149813 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59942) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:06:13.154006 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.v2.base [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Request body: {'floatingip': {'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'port_id': '549d8b87-c3cf-4a17-bfa0-15421b9689ff', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address': '172.20.0.12'}} {{(pid=109040) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 21 14:06:13.176186 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for floatingip, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:13.267350 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:13.374981 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_common [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Allocated IP 172.27.1.82 (67069811-a3d5-4953-8a57-e62d44750fe3/95d11680-e5b5-4d2e-bab7-c3bed6fa33a8/ec7b3a2d-e21f-48e9-9d87-61d093594d78) {{(pid=109040) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 21 14:06:13.475799 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for port, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:13.508039 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731000071846', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:13.547998 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Network 67069811-a3d5-4953-8a57-e62d44750fe3 is already hosted by enough agents. {{(pid=109040) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 21 14:06:13.550752 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.base_scheduler [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Resources bound (agent type, host, resource id): {{(pid=109040) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 21 14:06:13.554247 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Received port after_create {{(pid=109040) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 21 14:06:13.576237 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'Port': ['ID=ec7b3a2d-e21f-48e9-9d87-61d093594d78,revision_number=1']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:06:13.586249 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:13.586601 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:13.586942 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:13.587275 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:13.587615 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:13.587974 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:13.588303 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:13.588629 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:13.588955 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:13.589309 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:13.589629 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:13.589950 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:06:13.908422 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:13.974576 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-628585'] for port, before_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:14.119656 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for port, precommit_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:14.124200 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731000553018', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731000071864', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731000071882', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2298230'] for port, after_update {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:14.190853 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event updated for resources: {'Port': ['ID=ec7b3a2d-e21f-48e9-9d87-61d093594d78,revision_number=2']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:06:14.203505 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-470933'] for floatingip, after_create {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:14.302013 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.l3_db [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Floating IP cce5b69b-b947-4984-a0c2-c2eec12d4c10 associated. External IP: 172.27.1.82, port: 549d8b87-c3cf-4a17-bfa0-15421b9689ff. Nov 21 14:06:14.501084 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Router 04a22609-002c-4eb7-8a86-c6d6c65e2738 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 14:06:14.605151 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 14:06:14.614564 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c48e76a-84ca-4fff-a470-92c72855efa4 None None] Sync routers for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 14:06:14.622768 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:14.624496 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c48e76a-84ca-4fff-a470-92c72855efa4 None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:06:14.625600 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-7c48e76a-84ca-4fff-a470-92c72855efa4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:06:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:06:14.650324 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-20939f46-eac2-443d-87f5-e7d1f6b92dd4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.4995058 Nov 21 14:06:14.651279 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'tag': '549d8b87-c3cf-4a17-bfa0-15421b9689ff'}] {{(pid=109040) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:06:14.653707 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a0fb9e652e748194bc1d59d499050652e1260aa6f54aa3e041aed7364c74523c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c4a503da-6ebf-4c93-a070-f147ae18932f" -d '{"events": [{"name": "network-changed", "server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff"}]}' {{(pid=109040) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:06:14.690929 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 14:06:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b544adc4-893b-453e-9f3b-5e545fb6bc0b x-openstack-request-id: req-b544adc4-893b-453e-9f3b-5e545fb6bc0b {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:06:14.691224 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff", "status": "completed", "code": 200}]} {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:06:14.691476 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-b544adc4-893b-453e-9f3b-5e545fb6bc0b {{(pid=109040) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:06:14.691911 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'tag': '549d8b87-c3cf-4a17-bfa0-15421b9689ff', 'status': 'completed', 'code': 200} Nov 21 14:06:14.730220 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-7c48e76a-84ca-4fff-a470-92c72855efa4 None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:06:14.758310 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-dd924901-9795-40be-8d87-2a3fda9ea941 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:14.759820 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-dd924901-9795-40be-8d87-2a3fda9ea941 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 1099 time: 0.0398388 Nov 21 14:06:14.850618 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-ca4f7ec1-373b-491b-8d77-7d5e2817ec7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:14.852092 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-ca4f7ec1-373b-491b-8d77-7d5e2817ec7c service neutron] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 913 time: 0.0840328 Nov 21 14:06:14.917065 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-7974cdd6-1682-4c12-9a09-256c615ce954 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=549d8b87-c3cf-4a17-bfa0-15421b9689ff HTTP/1.1" status: 200 len: 999 time: 0.0579646 Nov 21 14:06:14.954761 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-7c48e76a-84ca-4fff-a470-92c72855efa4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'cce5b69b-b947-4984-a0c2-c2eec12d4c10', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.82', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': '549d8b87-c3cf-4a17-bfa0-15421b9689ff', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:d3:b6:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:06:13Z', 'updated_at': '2021-11-21T14:06:13Z', 'revision_number': 0, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}, {'id': 'd2aec114-7c6d-4830-8a52-47153d450a1a', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.148', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:a6:15:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:04:19Z', 'updated_at': '2021-11-21T14:04:21Z', 'revision_number': 1, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:06:14.969800 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-671eea32-63ad-4f4f-8fb9-fbf5425f3cac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:14.971226 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-671eea32-63ad-4f4f-8fb9-fbf5425f3cac service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0464313 Nov 21 14:06:14.980144 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c48e76a-84ca-4fff-a470-92c72855efa4 None None] Checking router: 04a22609-002c-4eb7-8a86-c6d6c65e2738 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 14:06:14.990730 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c48e76a-84ca-4fff-a470-92c72855efa4 None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:06:14.991331 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-7c48e76a-84ca-4fff-a470-92c72855efa4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:06:03Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:06:15.017878 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-1892d9ca-0060-4ffc-984e-cefae8d36596 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:06:15.019260 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-1892d9ca-0060-4ffc-984e-cefae8d36596 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0408113 Nov 21 14:06:15.108862 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-d4fb31d9-2522-423a-8925-a65b6370b445 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818853 Nov 21 14:06:15.205652 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-c4a503da-6ebf-4c93-a070-f147ae18932f req-a5099c2f-b283-473f-8cbe-e15d9f3b265d service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889521 Nov 21 14:06:15.224563 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-7c48e76a-84ca-4fff-a470-92c72855efa4 None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:06:15.446537 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-7c48e76a-84ca-4fff-a470-92c72855efa4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'cce5b69b-b947-4984-a0c2-c2eec12d4c10', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.82', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': '549d8b87-c3cf-4a17-bfa0-15421b9689ff', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:d3:b6:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:06:13Z', 'updated_at': '2021-11-21T14:06:13Z', 'revision_number': 0, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}, {'id': 'd2aec114-7c6d-4830-8a52-47153d450a1a', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.148', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:a6:15:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:04:19Z', 'updated_at': '2021-11-21T14:04:21Z', 'revision_number': 1, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:06:15.471654 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c48e76a-84ca-4fff-a470-92c72855efa4 None None] The sync data for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi is: [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'cce5b69b-b947-4984-a0c2-c2eec12d4c10', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.82', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': '549d8b87-c3cf-4a17-bfa0-15421b9689ff', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:d3:b6:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:06:13Z', 'updated_at': '2021-11-21T14:06:13Z', 'revision_number': 0, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}, {'id': 'd2aec114-7c6d-4830-8a52-47153d450a1a', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.148', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:a6:15:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:04:19Z', 'updated_at': '2021-11-21T14:04:21Z', 'revision_number': 1, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 14:06:15.666345 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3da4980f-6f97-4b6f-bbd9-4649a8da8021 None None] New status for floating IP cce5b69b-b947-4984-a0c2-c2eec12d4c10: ACTIVE {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 14:06:22.735649 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:30.231041 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0046c755-b904-4272-b84d-23f7bcda1f0c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:31.600323 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:06:32.588372 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-f9b4883e-b76b-4619-bd46-6c8e4e5f4e1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:33.928493 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:35.123497 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:35.887291 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:06:52.763371 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:00.232686 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c8e8ca74-92a3-4ea2-87ab-04d1a09aec17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:01.818802 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a64bbc32-ab75-4933-a747-6f70b886e1f6 req-df065692-9e07-4e1f-83c5-1e2296526d06 service neutron] 10.222.0.50 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0394716 Nov 21 14:07:01.901166 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a64bbc32-ab75-4933-a747-6f70b886e1f6 req-af88ad6f-b3dc-40b2-9310-7b089bec5e05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:01.902613 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a64bbc32-ab75-4933-a747-6f70b886e1f6 req-af88ad6f-b3dc-40b2-9310-7b089bec5e05 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 1099 time: 0.0390303 Nov 21 14:07:02.012188 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a64bbc32-ab75-4933-a747-6f70b886e1f6 req-5b3057f7-4a9b-4f41-b964-936332587839 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:02.013641 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a64bbc32-ab75-4933-a747-6f70b886e1f6 req-5b3057f7-4a9b-4f41-b964-936332587839 service neutron] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 913 time: 0.0853031 Nov 21 14:07:02.082234 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a64bbc32-ab75-4933-a747-6f70b886e1f6 req-7ecf2b05-58e0-4c64-bc12-d53eed7476f4 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cbc8a307-df34-44fb-9201-3c417eda1bd8 HTTP/1.1" status: 200 len: 1002 time: 0.0558641 Nov 21 14:07:02.137503 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a64bbc32-ab75-4933-a747-6f70b886e1f6 req-9310a971-325c-478a-937a-109eb07f8540 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:02.138892 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a64bbc32-ab75-4933-a747-6f70b886e1f6 req-9310a971-325c-478a-937a-109eb07f8540 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0460804 Nov 21 14:07:02.186340 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a64bbc32-ab75-4933-a747-6f70b886e1f6 req-ac0edc7a-2e62-4eb0-96f7-613bc720d6c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:02.187771 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a64bbc32-ab75-4933-a747-6f70b886e1f6 req-ac0edc7a-2e62-4eb0-96f7-613bc720d6c1 service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0386310 Nov 21 14:07:02.279437 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a64bbc32-ab75-4933-a747-6f70b886e1f6 req-c75d7f08-347c-4dee-bd10-a90c11099efb service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0799911 Nov 21 14:07:02.372919 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-a64bbc32-ab75-4933-a747-6f70b886e1f6 req-d6ec02bb-a2f0-4368-aec7-4aad53f27d69 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851486 Nov 21 14:07:02.588936 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-7f0ba3d2-be50-49a0-a68c-f5ff3a01ef35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:03.932281 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:05.125879 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:05.887686 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:08.599771 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:07:14.367322 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [req-019f3e65-def8-412e-9cc3-d64f412c98fa req-286c59df-eec5-417a-bd87-134a4fe2a628 service neutron] (109040) timed out ('10.222.0.50', 61799) {{(pid=109040) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 21 14:07:20.329313 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [req-a448820a-51e8-4154-af11-fe69eadc54d7 req-404be6e4-49ad-4d25-84f2-05e6b134e098 service neutron] (109040) timed out ('10.222.0.50', 61816) {{(pid=109040) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 21 14:07:22.768860 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:30.234724 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-21423bb9-63e7-41c8-b3f9-b78c0c0afa8c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:32.590449 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-e67c7225-fb29-49fa-86ad-f2e32426b639 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:33.938401 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:35.129477 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:35.888530 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:41.992218 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 59976) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:07:42.192233 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Deleting port ec7b3a2d-e21f-48e9-9d87-61d093594d78 {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:07:42.192577 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:42.268880 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:42.269119 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:42.280707 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling delete_port for ec7b3a2d-e21f-48e9-9d87-61d093594d78 owned by network:floatingip {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:07:42.419583 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:42.447045 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event deleted for resources: {'Port': ['ID=ec7b3a2d-e21f-48e9-9d87-61d093594d78,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:07:42.458668 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:42.459127 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:42.459533 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:42.459885 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:42.460222 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:42.460555 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:42.460884 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:42.461210 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:42.461536 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:42.461892 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:42.462214 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:42.462535 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109040) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:42.514012 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for floatingip, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:42.514395 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.l3_db [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Floating IP cce5b69b-b947-4984-a0c2-c2eec12d4c10 disassociated (deleted). External IP: 172.27.1.82, port: 549d8b87-c3cf-4a17-bfa0-15421b9689ff. Nov 21 14:07:42.713916 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Router 04a22609-002c-4eb7-8a86-c6d6c65e2738 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 14:07:42.816808 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 14:07:42.821702 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:42.826036 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-057021d9-0787-4d59-97ec-c4de0591a04e None None] Sync routers for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 14:07:42.835189 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-057021d9-0787-4d59-97ec-c4de0591a04e None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:07:42.835786 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-057021d9-0787-4d59-97ec-c4de0591a04e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:07:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:42.846677 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-b692a594-0d07-4309-b2fc-cf36b38c1ba6 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "DELETE /v2.0/floatingips/cce5b69b-b947-4984-a0c2-c2eec12d4c10 HTTP/1.1" status: 204 len: 168 time: 0.8531089 Nov 21 14:07:42.847275 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'tag': '549d8b87-c3cf-4a17-bfa0-15421b9689ff'}] {{(pid=109040) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:07:42.849569 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a0fb9e652e748194bc1d59d499050652e1260aa6f54aa3e041aed7364c74523c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3c07dc0-ec11-444b-acb5-bf1957528764" -d '{"events": [{"name": "network-changed", "server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff"}]}' {{(pid=109040) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:07:42.890599 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 14:07:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0aebaec8-405e-449d-8cf4-4750f6a3346d x-openstack-request-id: req-0aebaec8-405e-449d-8cf4-4750f6a3346d {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:07:42.890897 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff", "status": "completed", "code": 200}]} {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:07:42.891156 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-0aebaec8-405e-449d-8cf4-4750f6a3346d {{(pid=109040) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:07:42.891567 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'tag': '549d8b87-c3cf-4a17-bfa0-15421b9689ff', 'status': 'completed', 'code': 200} Nov 21 14:07:42.944637 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-057021d9-0787-4d59-97ec-c4de0591a04e None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:07:42.962963 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-44f41af4-5ea0-412f-a8ab-643f7adb10f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:42.965150 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-44f41af4-5ea0-412f-a8ab-643f7adb10f8 service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 1099 time: 0.0432475 Nov 21 14:07:43.074627 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-6b0fc30a-dd60-4e09-8f16-924a25026421 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:43.076201 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-6b0fc30a-dd60-4e09-8f16-924a25026421 service neutron] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 913 time: 0.0959010 Nov 21 14:07:43.125898 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-c3260cd0-fa8c-4990-8335-5407e86b5f5e service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=549d8b87-c3cf-4a17-bfa0-15421b9689ff HTTP/1.1" status: 200 len: 217 time: 0.0416491 Nov 21 14:07:43.173055 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-057021d9-0787-4d59-97ec-c4de0591a04e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'd2aec114-7c6d-4830-8a52-47153d450a1a', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.148', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:a6:15:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:04:19Z', 'updated_at': '2021-11-21T14:04:21Z', 'revision_number': 1, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:43.198625 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-057021d9-0787-4d59-97ec-c4de0591a04e None None] Checking router: 04a22609-002c-4eb7-8a86-c6d6c65e2738 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 14:07:43.201860 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-123033fa-8032-435c-834e-d9ebf8acca80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:43.203322 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-123033fa-8032-435c-834e-d9ebf8acca80 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0692565 Nov 21 14:07:43.207331 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-057021d9-0787-4d59-97ec-c4de0591a04e None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:07:43.207955 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-057021d9-0787-4d59-97ec-c4de0591a04e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:07:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:43.212203 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bcc60fe-7ed3-4d48-aca0-d84f54aab67b req-ed05f71f-05a2-4ef3-bfe6-8f059e7c89cc tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:43.213576 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2bcc60fe-7ed3-4d48-aca0-d84f54aab67b req-ed05f71f-05a2-4ef3-bfe6-8f059e7c89cc tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 946 time: 0.1809516 Nov 21 14:07:43.279955 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-47c6795c-da0d-43e2-9c61-5cd238501d2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:43.281458 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-47c6795c-da0d-43e2-9c61-5cd238501d2d service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0670359 Nov 21 14:07:43.291117 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-2bcc60fe-7ed3-4d48-aca0-d84f54aab67b req-b5725f92-1f98-43dd-b155-2def55e71fbc tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0681198 Nov 21 14:07:43.311839 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-057021d9-0787-4d59-97ec-c4de0591a04e None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:07:43.378908 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-d602c768-ea81-4028-9dea-4659b1d5bcbf service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868351 Nov 21 14:07:43.475491 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-e3c07dc0-ec11-444b-acb5-bf1957528764 req-110b0ce0-2fb4-4df8-ae01-858942c40ba0 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854819 Nov 21 14:07:43.538304 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-057021d9-0787-4d59-97ec-c4de0591a04e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'd2aec114-7c6d-4830-8a52-47153d450a1a', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.148', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:a6:15:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:04:19Z', 'updated_at': '2021-11-21T14:04:21Z', 'revision_number': 1, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:43.566326 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-057021d9-0787-4d59-97ec-c4de0591a04e None None] The sync data for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi is: [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_floatingips': [{'id': 'd2aec114-7c6d-4830-8a52-47153d450a1a', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'floating_ip_address': '172.27.1.148', 'floating_network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'router_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'port_id': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'mac_address': 'fa:16:3e:a6:15:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-21T14:04:19Z', 'updated_at': '2021-11-21T14:04:21Z', 'revision_number': 1, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 14:07:43.771970 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e759c34a-db78-445a-96d5-e1a2c5a6b795 None None] New status for floating IP cce5b69b-b947-4984-a0c2-c2eec12d4c10: DOWN {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 14:07:44.451577 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2631008d-ef8a-4a31-9554-cd185ca0b941 req-872e368f-de81-49ec-b2d6-11df9681d99a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:44.453073 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2631008d-ef8a-4a31-9554-cd185ca0b941 req-872e368f-de81-49ec-b2d6-11df9681d99a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 946 time: 0.0930889 Nov 21 14:07:44.501091 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-2631008d-ef8a-4a31-9554-cd185ca0b941 req-ef296196-8dce-47d9-8d21-bf80b4ec647a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421653 Nov 21 14:07:44.910638 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44c795ce-5634-49cc-ab0e-9c19d3f7030b req-b563b0ee-2a9d-46a0-a00a-75d79758e211 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:44.911999 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-44c795ce-5634-49cc-ab0e-9c19d3f7030b req-b563b0ee-2a9d-46a0-a00a-75d79758e211 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 946 time: 0.0480673 Nov 21 14:07:45.006815 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-44c795ce-5634-49cc-ab0e-9c19d3f7030b req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Deleting port 549d8b87-c3cf-4a17-bfa0-15421b9689ff {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:07:45.007150 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-44c795ce-5634-49cc-ab0e-9c19d3f7030b req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:45.092617 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-44c795ce-5634-49cc-ab0e-9c19d3f7030b req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] For port 549d8b87-c3cf-4a17-bfa0-15421b9689ff, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=549d8b87-c3cf-4a17-bfa0-15421b9689ff,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:07:45.092976 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-44c795ce-5634-49cc-ab0e-9c19d3f7030b req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:45.105654 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-44c795ce-5634-49cc-ab0e-9c19d3f7030b req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling delete_port for 549d8b87-c3cf-4a17-bfa0-15421b9689ff owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:07:45.229374 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-44c795ce-5634-49cc-ab0e-9c19d3f7030b req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:45.255179 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event deleted for resources: {'Port': ['ID=549d8b87-c3cf-4a17-bfa0-15421b9689ff,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:07:45.284202 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:45.284551 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:45.284893 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:45.285225 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:45.285556 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:45.285887 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:45.286213 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:45.286538 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:45.286859 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:45.287188 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:45.287508 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:45.287866 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109041) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:45.311781 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-44c795ce-5634-49cc-ab0e-9c19d3f7030b req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] No DVR routers for this DVR port 549d8b87-c3cf-4a17-bfa0-15421b9689ff on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 14:07:45.314152 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-44c795ce-5634-49cc-ab0e-9c19d3f7030b req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:45.318083 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-44c795ce-5634-49cc-ab0e-9c19d3f7030b req-ebb99f67-71f7-4185-b383-1e0dbd48c18a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "DELETE /v2.0/ports/549d8b87-c3cf-4a17-bfa0-15421b9689ff HTTP/1.1" status: 204 len: 173 time: 0.3956008 Nov 21 14:07:45.318519 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'name': 'network-vif-deleted', 'tag': '549d8b87-c3cf-4a17-bfa0-15421b9689ff'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:07:45.320756 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1fdd7112-b52d-492f-97db-a66d16aac527" -d '{"events": [{"server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "name": "network-vif-deleted", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:07:45.357225 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 14:07:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fa8affe0-532a-4c71-954a-a03b9c83ee46 x-openstack-request-id: req-fa8affe0-532a-4c71-954a-a03b9c83ee46 {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:07:45.357523 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1153565e-8e49-4741-9f8c-52876f41f5f7", "name": "network-vif-deleted", "tag": "549d8b87-c3cf-4a17-bfa0-15421b9689ff", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:07:45.357780 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-fa8affe0-532a-4c71-954a-a03b9c83ee46 {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:07:45.358183 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1153565e-8e49-4741-9f8c-52876f41f5f7', 'name': 'network-vif-deleted', 'tag': '549d8b87-c3cf-4a17-bfa0-15421b9689ff', 'status': 'completed', 'code': 200} Nov 21 14:07:45.600644 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:07:45.603029 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-366586ff-0735-4e2b-bc5c-c081bcf95829 req-cf08158b-b186-4d17-8180-bcb1398915c4 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=1153565e-8e49-4741-9f8c-52876f41f5f7 HTTP/1.1" status: 200 len: 210 time: 0.0352881 Nov 21 14:07:48.522746 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 549d8b87-c3cf-4a17-bfa0-15421b9689ff no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 14:07:48.542648 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: 549d8b87-c3cf-4a17-bfa0-15421b9689ff {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 14:07:48.542933 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device 549d8b87-c3cf-4a17-bfa0-15421b9689ff not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 14:07:48.882798 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 60022) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:07:49.037607 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-32b18db5-5cc0-4259-ac41-df4bd6d98e62 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Deleting port ee661cd4-ef3e-4c64-96b0-f614157d4da2 {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:07:49.037943 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-32b18db5-5cc0-4259-ac41-df4bd6d98e62 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:49.108900 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-32b18db5-5cc0-4259-ac41-df4bd6d98e62 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:49.109226 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-32b18db5-5cc0-4259-ac41-df4bd6d98e62 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:49.120869 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-32b18db5-5cc0-4259-ac41-df4bd6d98e62 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling delete_port for ee661cd4-ef3e-4c64-96b0-f614157d4da2 owned by network:floatingip {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:07:49.266943 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-32b18db5-5cc0-4259-ac41-df4bd6d98e62 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:49.293539 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32b18db5-5cc0-4259-ac41-df4bd6d98e62 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event deleted for resources: {'Port': ['ID=ee661cd4-ef3e-4c64-96b0-f614157d4da2,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:07:49.352663 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-32b18db5-5cc0-4259-ac41-df4bd6d98e62 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for floatingip, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:49.352993 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.db.l3_db [None req-32b18db5-5cc0-4259-ac41-df4bd6d98e62 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Floating IP d2aec114-7c6d-4830-8a52-47153d450a1a disassociated (deleted). External IP: 172.27.1.148, port: cbc8a307-df34-44fb-9201-3c417eda1bd8. Nov 21 14:07:49.766735 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32b18db5-5cc0-4259-ac41-df4bd6d98e62 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Router 04a22609-002c-4eb7-8a86-c6d6c65e2738 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 14:07:49.869981 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32b18db5-5cc0-4259-ac41-df4bd6d98e62 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 14:07:49.874656 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-32b18db5-5cc0-4259-ac41-df4bd6d98e62 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:49.879827 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f0c8914-af2d-491f-9b27-5bab10df03f2 None None] Sync routers for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 14:07:49.888922 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f0c8914-af2d-491f-9b27-5bab10df03f2 None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:07:49.889514 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-1f0c8914-af2d-491f-9b27-5bab10df03f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:07:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:49.900435 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-32b18db5-5cc0-4259-ac41-df4bd6d98e62 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "DELETE /v2.0/floatingips/d2aec114-7c6d-4830-8a52-47153d450a1a HTTP/1.1" status: 204 len: 168 time: 1.0165815 Nov 21 14:07:49.901123 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'tag': 'cbc8a307-df34-44fb-9201-3c417eda1bd8'}] {{(pid=109040) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:07:49.903482 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a0fb9e652e748194bc1d59d499050652e1260aa6f54aa3e041aed7364c74523c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c394cb9-8f31-449e-a8e9-34d45c674dd1" -d '{"events": [{"name": "network-changed", "server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8"}]}' {{(pid=109040) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:07:49.944628 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sun, 21 Nov 2021 14:07:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b51f8b0d-b2b6-4102-b48b-8f8f60d05ad2 x-openstack-request-id: req-b51f8b0d-b2b6-4102-b48b-8f8f60d05ad2 {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:07:49.944935 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8", "status": "completed", "code": 200}]} {{(pid=109040) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:07:49.945201 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-b51f8b0d-b2b6-4102-b48b-8f8f60d05ad2 {{(pid=109040) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:07:49.945614 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'tag': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'status': 'completed', 'code': 200} Nov 21 14:07:49.998402 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-1f0c8914-af2d-491f-9b27-5bab10df03f2 None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:07:50.017189 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-b14514e5-a270-45b0-af8c-3177c04cad9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:50.018790 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-b14514e5-a270-45b0-af8c-3177c04cad9d service neutron] 10.222.0.50 "GET /v2.0/ports?tenant_id=db51095fd43e4fe5855207bd0ea7a651&device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 1099 time: 0.0428808 Nov 21 14:07:50.156528 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-03106510-212a-4e9c-972d-0953cf5afaa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:50.158529 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-03106510-212a-4e9c-972d-0953cf5afaa0 service neutron] 10.222.0.50 "GET /v2.0/networks?id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 200 len: 913 time: 0.1198120 Nov 21 14:07:50.165954 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92469ad8-41db-437d-8cc9-0221e3bb3110 req-41f1aae0-167e-442a-ab3e-6ddb6d4a5732 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:50.167310 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-92469ad8-41db-437d-8cc9-0221e3bb3110 req-41f1aae0-167e-442a-ab3e-6ddb6d4a5732 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 946 time: 0.0827579 Nov 21 14:07:50.199649 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-1f0c8914-af2d-491f-9b27-5bab10df03f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:50.206882 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-65ca8a87-1fe2-4eca-b790-a19a9a570ce5 service neutron] 10.222.0.50 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cbc8a307-df34-44fb-9201-3c417eda1bd8 HTTP/1.1" status: 200 len: 217 time: 0.0386188 Nov 21 14:07:50.225232 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f0c8914-af2d-491f-9b27-5bab10df03f2 None None] Checking router: 04a22609-002c-4eb7-8a86-c6d6c65e2738 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 14:07:50.233311 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f0c8914-af2d-491f-9b27-5bab10df03f2 None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:07:50.233906 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-1f0c8914-af2d-491f-9b27-5bab10df03f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:07:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:50.282230 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-92469ad8-41db-437d-8cc9-0221e3bb3110 req-428903ae-d716-4b4f-8fea-f04c03794f67 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1069996 Nov 21 14:07:50.284333 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-4a0f8170-0f8a-4285-8948-80d5d10318f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:50.285715 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-4a0f8170-0f8a-4285-8948-80d5d10318f8 service neutron] 10.222.0.50 "GET /v2.0/subnets?id=31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 200 len: 851 time: 0.0712991 Nov 21 14:07:50.336288 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-7d3b13dd-49f5-48b6-a111-10cd7f51b6df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:50.337803 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-7d3b13dd-49f5-48b6-a111-10cd7f51b6df service neutron] 10.222.0.50 "GET /v2.0/ports?network_id=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0433116 Nov 21 14:07:50.430961 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-1ef207db-d437-49f0-82ca-f6ba0de8d986 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841517 Nov 21 14:07:50.462229 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-1f0c8914-af2d-491f-9b27-5bab10df03f2 None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:07:50.526909 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-9c394cb9-8f31-449e-a8e9-34d45c674dd1 req-f8a4bd2e-1f41-400e-a92d-f78ecd931d23 service neutron] 10.222.0.50 "GET /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880306 Nov 21 14:07:50.655962 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-1f0c8914-af2d-491f-9b27-5bab10df03f2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:50.685185 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f0c8914-af2d-491f-9b27-5bab10df03f2 None None] The sync data for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi is: [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:18Z', 'revision_number': 4, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi', '_interfaces': [{'id': 'dbdeefa8-a396-487a-aa91-907825e1f4f0', 'name': '', 'network_id': '4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'mac_address': 'fa:16:3e:d8:70:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:18Z', 'updated_at': '2021-11-21T14:01:24Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'subnets': [{'id': '31e0485c-71ee-4ce4-8683-27185a5c5f72', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 14:07:50.895410 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0d9568b-186e-4c47-8df8-f20466502442 None None] New status for floating IP d2aec114-7c6d-4830-8a52-47153d450a1a: DOWN {{(pid=109043) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 21 14:07:51.401337 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b86c6da2-3876-47ac-b7b0-c5d75f68d28c req-c0bba4b1-481e-4aa2-a0e1-0a442730c37a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109040) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:51.402829 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b86c6da2-3876-47ac-b7b0-c5d75f68d28c req-c0bba4b1-481e-4aa2-a0e1-0a442730c37a tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 946 time: 0.0515735 Nov 21 14:07:51.452247 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-b86c6da2-3876-47ac-b7b0-c5d75f68d28c req-9bb4ade4-5ea5-4b9e-a710-c219ac889749 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/security-groups?id=238d71da-b989-4fea-9e58-80ca9534d132&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431752 Nov 21 14:07:51.866640 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5e4c484-844d-4118-bb65-e7ae1e79c06b req-1d2a56b7-0d46-48fc-b53d-6ba499892bdc tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109041) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 21 14:07:51.868355 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b5e4c484-844d-4118-bb65-e7ae1e79c06b req-1d2a56b7-0d46-48fc-b53d-6ba499892bdc tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 946 time: 0.0478351 Nov 21 14:07:51.964578 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-b5e4c484-844d-4118-bb65-e7ae1e79c06b req-c9c435a4-6849-4d4b-bea5-c9efe05f0a99 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Deleting port cbc8a307-df34-44fb-9201-3c417eda1bd8 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:07:51.964922 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-b5e4c484-844d-4118-bb65-e7ae1e79c06b req-c9c435a4-6849-4d4b-bea5-c9efe05f0a99 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:52.051151 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [req-b5e4c484-844d-4118-bb65-e7ae1e79c06b req-c9c435a4-6849-4d4b-bea5-c9efe05f0a99 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] For port cbc8a307-df34-44fb-9201-3c417eda1bd8, host hv-cinder-76845, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76845',level=0,port_id=cbc8a307-df34-44fb-9201-3c417eda1bd8,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:07:52.051516 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-b5e4c484-844d-4118-bb65-e7ae1e79c06b req-c9c435a4-6849-4d4b-bea5-c9efe05f0a99 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:52.063728 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [req-b5e4c484-844d-4118-bb65-e7ae1e79c06b req-c9c435a4-6849-4d4b-bea5-c9efe05f0a99 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling delete_port for cbc8a307-df34-44fb-9201-3c417eda1bd8 owned by compute:nova {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:07:52.188057 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-b5e4c484-844d-4118-bb65-e7ae1e79c06b req-c9c435a4-6849-4d4b-bea5-c9efe05f0a99 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:52.215339 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9c435a4-6849-4d4b-bea5-c9efe05f0a99 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event deleted for resources: {'Port': ['ID=cbc8a307-df34-44fb-9201-3c417eda1bd8,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:07:52.259619 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [req-b5e4c484-844d-4118-bb65-e7ae1e79c06b req-c9c435a4-6849-4d4b-bea5-c9efe05f0a99 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] No DVR routers for this DVR port cbc8a307-df34-44fb-9201-3c417eda1bd8 on host hv-cinder-76845 {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 14:07:52.262286 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [req-b5e4c484-844d-4118-bb65-e7ae1e79c06b req-c9c435a4-6849-4d4b-bea5-c9efe05f0a99 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for port, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:52.265727 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [req-b5e4c484-844d-4118-bb65-e7ae1e79c06b req-c9c435a4-6849-4d4b-bea5-c9efe05f0a99 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.50 "DELETE /v2.0/ports/cbc8a307-df34-44fb-9201-3c417eda1bd8 HTTP/1.1" status: 204 len: 173 time: 0.3865848 Nov 21 14:07:52.266297 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'name': 'network-vif-deleted', 'tag': 'cbc8a307-df34-44fb-9201-3c417eda1bd8'}] {{(pid=109041) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 21 14:07:52.268515 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}35293aec6a5be94f49e4982e95936fe51c8946026c34894ef348d8ec2645eee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9871966f-b5de-47d7-878c-e7ec640f97c7" -d '{"events": [{"server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "name": "network-vif-deleted", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8"}]}' {{(pid=109041) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 21 14:07:52.311050 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sun, 21 Nov 2021 14:07:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c52a388a-2142-44f7-add1-5557ace858ef x-openstack-request-id: req-c52a388a-2142-44f7-add1-5557ace858ef {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 21 14:07:52.311351 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "98c31c5e-7ef4-4ff9-a333-f27db4050a2e", "name": "network-vif-deleted", "tag": "cbc8a307-df34-44fb-9201-3c417eda1bd8", "status": "completed", "code": 200}]} {{(pid=109041) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 21 14:07:52.311604 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-c52a388a-2142-44f7-add1-5557ace858ef {{(pid=109041) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 21 14:07:52.312067 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '98c31c5e-7ef4-4ff9-a333-f27db4050a2e', 'name': 'network-vif-deleted', 'tag': 'cbc8a307-df34-44fb-9201-3c417eda1bd8', 'status': 'completed', 'code': 200} Nov 21 14:07:52.547413 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [req-5287124e-877e-444d-a860-0b5215c8937a req-1c48cb58-6b56-4839-abd1-e289d16adc72 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "GET /v2.0/ports?device_id=98c31c5e-7ef4-4ff9-a333-f27db4050a2e HTTP/1.1" status: 200 len: 210 time: 0.0261507 Nov 21 14:07:52.780708 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:53.601976 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 60038) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:07:53.727333 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-993a16ef-c785-43b6-b5d5-3be57483f164 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Deleting port d412319b-06cc-4413-812a-e450820c58b0 {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:07:53.727677 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-993a16ef-c785-43b6-b5d5-3be57483f164 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:53.804877 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-993a16ef-c785-43b6-b5d5-3be57483f164 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:53.805204 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-993a16ef-c785-43b6-b5d5-3be57483f164 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:53.817403 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-993a16ef-c785-43b6-b5d5-3be57483f164 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Calling delete_port for d412319b-06cc-4413-812a-e450820c58b0 owned by network:floatingip {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:07:53.941446 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-993a16ef-c785-43b6-b5d5-3be57483f164 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:53.970848 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-993a16ef-c785-43b6-b5d5-3be57483f164 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event deleted for resources: {'Port': ['ID=d412319b-06cc-4413-812a-e450820c58b0,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:07:54.027468 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-993a16ef-c785-43b6-b5d5-3be57483f164 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for floatingip, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:54.030428 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-993a16ef-c785-43b6-b5d5-3be57483f164 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2024108'] for floatingip, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:54.032343 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-993a16ef-c785-43b6-b5d5-3be57483f164 tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "DELETE /v2.0/floatingips/4aed3a7e-de05-46d8-9441-146e97ca2a5a HTTP/1.1" status: 204 len: 168 time: 0.4293134 Nov 21 14:07:55.224299 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 60050) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:07:55.278745 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-abadaf62-84a8-4a4e-94cd-e576d335e61f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:55.303586 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-abadaf62-84a8-4a4e-94cd-e576d335e61f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:55.360758 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-abadaf62-84a8-4a4e-94cd-e576d335e61f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:55.363504 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-abadaf62-84a8-4a4e-94cd-e576d335e61f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:55.364681 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-abadaf62-84a8-4a4e-94cd-e576d335e61f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] 10.222.0.11 "DELETE /v2.0/security-groups/238d71da-b989-4fea-9e58-80ca9534d132 HTTP/1.1" status: 204 len: 168 time: 0.1393976 Nov 21 14:07:55.373939 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abadaf62-84a8-4a4e-94cd-e576d335e61f tempest-TestVolumeBootPattern-1750994094 tempest-TestVolumeBootPattern-1750994094-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=238d71da-b989-4fea-9e58-80ca9534d132,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:07:55.422333 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 60054) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:07:55.859573 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-103b0192-3003-48ed-a7b2-8bd8e493c7c5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-473237'] for router_interface, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:56.094655 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-103b0192-3003-48ed-a7b2-8bd8e493c7c5 admin admin] Deleting port dbdeefa8-a396-487a-aa91-907825e1f4f0 {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:07:56.094992 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-103b0192-3003-48ed-a7b2-8bd8e493c7c5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:56.169938 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-103b0192-3003-48ed-a7b2-8bd8e493c7c5 admin admin] For port dbdeefa8-a396-487a-aa91-907825e1f4f0, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=dbdeefa8-a396-487a-aa91-907825e1f4f0,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:07:56.170225 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-103b0192-3003-48ed-a7b2-8bd8e493c7c5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:56.186509 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-103b0192-3003-48ed-a7b2-8bd8e493c7c5 admin admin] Calling delete_port for dbdeefa8-a396-487a-aa91-907825e1f4f0 owned by network:router_interface {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:07:56.358936 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-103b0192-3003-48ed-a7b2-8bd8e493c7c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:56.385366 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-103b0192-3003-48ed-a7b2-8bd8e493c7c5 admin admin] Pushing event deleted for resources: {'Port': ['ID=dbdeefa8-a396-487a-aa91-907825e1f4f0,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:07:56.535824 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device cbc8a307-df34-44fb-9201-3c417eda1bd8 no longer exists at agent hyperv_hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 14:07:56.548070 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-103b0192-3003-48ed-a7b2-8bd8e493c7c5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1684491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-473209'] for router_interface, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:56.555334 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] No Port match for: cbc8a307-df34-44fb-9201-3c417eda1bd8 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 14:07:56.555685 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Device cbc8a307-df34-44fb-9201-3c417eda1bd8 not bound to the agent host hv-cinder-76845 {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 14:07:56.760889 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-103b0192-3003-48ed-a7b2-8bd8e493c7c5 admin admin] Router 04a22609-002c-4eb7-8a86-c6d6c65e2738 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109040) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 14:07:56.866564 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-103b0192-3003-48ed-a7b2-8bd8e493c7c5 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109040) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 14:07:56.871921 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-103b0192-3003-48ed-a7b2-8bd8e493c7c5 admin admin] 10.222.0.11 "PUT /v2.0/routers/04a22609-002c-4eb7-8a86-c6d6c65e2738/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4485269 Nov 21 14:07:56.874522 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 60058) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:07:56.876305 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-902f3ced-686c-4faf-ab99-cb2b7c8b3b56 None None] Sync routers for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 14:07:56.891963 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-902f3ced-686c-4faf-ab99-cb2b7c8b3b56 None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:07:56.893235 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-902f3ced-686c-4faf-ab99-cb2b7c8b3b56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:07:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:56.977812 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Publish callbacks [] for router, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:56.997585 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-902f3ced-686c-4faf-ab99-cb2b7c8b3b56 None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:07:57.076396 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.127397 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Deleting port a7eec2f6-2747-4e84-adcf-05431129442c {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:07:57.127733 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.171405 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-902f3ced-686c-4faf-ab99-cb2b7c8b3b56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53'}], 'enable_snat': True}, 'gw_port_id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:07:56Z', 'revision_number': 5, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port': {'id': 'a7eec2f6-2747-4e84-adcf-05431129442c', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e8:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:01:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:57.197529 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-902f3ced-686c-4faf-ab99-cb2b7c8b3b56 None None] Checking router: 04a22609-002c-4eb7-8a86-c6d6c65e2738 for host: dv-cinder-768458-12-iscsi {{(pid=109042) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 14:07:57.202641 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] For port a7eec2f6-2747-4e84-adcf-05431129442c, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=a7eec2f6-2747-4e84-adcf-05431129442c,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:07:57.203006 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.206209 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-902f3ced-686c-4faf-ab99-cb2b7c8b3b56 None None] Routers {'04a22609-002c-4eb7-8a86-c6d6c65e2738'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109042) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:07:57.206802 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-902f3ced-686c-4faf-ab99-cb2b7c8b3b56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:07:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['04a22609-002c-4eb7-8a86-c6d6c65e2738'], 'active': True} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:57.219407 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Calling delete_port for a7eec2f6-2747-4e84-adcf-05431129442c owned by network:router_gateway {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:07:57.293173 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvr_db [None req-902f3ced-686c-4faf-ab99-cb2b7c8b3b56 None None] Set router 04a22609-002c-4eb7-8a86-c6d6c65e2738 gateway port host: None {{(pid=109042) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:07:57.347131 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_hamode_db [None req-902f3ced-686c-4faf-ab99-cb2b7c8b3b56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:07:57Z', 'revision_number': 6, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port_host': None}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109042) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:57.373050 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-902f3ced-686c-4faf-ab99-cb2b7c8b3b56 None None] The sync data for ids ['04a22609-002c-4eb7-8a86-c6d6c65e2738'] in dv-cinder-768458-12-iscsi is: [{'id': '04a22609-002c-4eb7-8a86-c6d6c65e2738', 'name': 'tempest-TestVolumeBootPattern-1634958314-router', 'tenant_id': 'db51095fd43e4fe5855207bd0ea7a651', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:16Z', 'updated_at': '2021-11-21T14:07:57Z', 'revision_number': 6, 'project_id': 'db51095fd43e4fe5855207bd0ea7a651', 'gw_port_host': None}] {{(pid=109042) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 14:07:57.386660 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.419972 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Pushing event deleted for resources: {'Port': ['ID=a7eec2f6-2747-4e84-adcf-05431129442c,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:07:57.474358 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-471003'] for router_gateway, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.564819 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-470817', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-58426'] for router, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.566811 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.609873 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-470840'] for router, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.610407 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 04a22609-002c-4eb7-8a86-c6d6c65e2738 {{(pid=109040) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 21 14:07:57.615465 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] Publish callbacks [] for router, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.616695 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-fc468444-f85a-4c21-9779-804d0f375d32 admin admin] 10.222.0.11 "DELETE /v2.0/routers/04a22609-002c-4eb7-8a86-c6d6c65e2738 HTTP/1.1" status: 204 len: 168 time: 0.7411101 Nov 21 14:07:57.619555 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 60060) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:07:57.662011 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.db_base_plugin_v2 [None req-d46a9045-eaab-4022-9ad8-f0c96df526be admin admin] Deleting subnet 31e0485c-71ee-4ce4-8683-27185a5c5f72 {{(pid=109040) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 14:07:57.664897 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d46a9045-eaab-4022-9ad8-f0c96df526be admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.699839 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d46a9045-eaab-4022-9ad8-f0c96df526be admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-261998919'] for subnet, precommit_delete_associations {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.785080 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d46a9045-eaab-4022-9ad8-f0c96df526be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.834698 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d46a9045-eaab-4022-9ad8-f0c96df526be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2298272', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261670867'] for subnet, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.860704 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d46a9045-eaab-4022-9ad8-f0c96df526be admin admin] Pushing event deleted for resources: {'Subnet': ['ID=31e0485c-71ee-4ce4-8683-27185a5c5f72,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:07:57.863425 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-d46a9045-eaab-4022-9ad8-f0c96df526be admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for subnet, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.866504 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-d46a9045-eaab-4022-9ad8-f0c96df526be admin admin] 10.222.0.11 "DELETE /v2.0/subnets/31e0485c-71ee-4ce4-8683-27185a5c5f72 HTTP/1.1" status: 204 len: 168 time: 0.2460117 Nov 21 14:07:57.867068 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ff68a35-3d41-4d36-9b97-c971e6af1420 None None] Network 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 14:07:57.869298 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 60062) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:07:57.935948 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:57.996222 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Deleting port c41a3c92-fc90-499b-be69-ecc313c6c77e {{(pid=109040) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:07:57.996561 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:58.056748 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.db [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] For port c41a3c92-fc90-499b-be69-ecc313c6c77e, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=c41a3c92-fc90-499b-be69-ecc313c6c77e,segment=NetworkSegment(2f57cdde-a3c9-40c0-88f0-211e71097d2d),segment_id=2f57cdde-a3c9-40c0-88f0-211e71097d2d)] {{(pid=109040) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:07:58.057041 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:58.069137 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.plugin [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Calling delete_port for c41a3c92-fc90-499b-be69-ecc313c6c77e owned by network:dhcp {{(pid=109040) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:07:58.115563 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] DHCP port deletion for 4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 request from dv-cinder-768458-12-iscsi {{(pid=109042) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 21 14:07:58.155569 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2298239'] for port, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:58.166419 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Deleting port c41a3c92-fc90-499b-be69-ecc313c6c77e {{(pid=109042) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:07:58.166796 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:58.183816 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] No DVR routers for this DVR port c41a3c92-fc90-499b-be69-ecc313c6c77e on host dv-cinder-768458-12-iscsi {{(pid=109040) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 14:07:58.187575 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Pushing event deleted for resources: {'Port': ['ID=c41a3c92-fc90-499b-be69-ecc313c6c77e,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:07:58.231371 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.db [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] For port c41a3c92-fc90-499b-be69-ecc313c6c77e, host dv-cinder-768458-12-iscsi, got binding levels [] {{(pid=109042) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:07:58.231771 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:58.249598 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Calling delete_port for c41a3c92-fc90-499b-be69-ecc313c6c77e owned by network:dhcp {{(pid=109042) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:07:58.252940 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.ipam_backend_mixin [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Port c41a3c92-fc90-499b-be69-ecc313c6c77e was not found and therefore no delete operation was performed {{(pid=109042) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 21 14:07:58.254248 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855'] for port, after_delete {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:58.258168 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:58.279531 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8']}} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:58.280571 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Pushing event deleted for resources: {'Port': ['ID=c41a3c92-fc90-499b-be69-ecc313c6c77e,revision_number=None']} {{(pid=109042) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:07:58.283382 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] No DVR routers for this DVR port c41a3c92-fc90-499b-be69-ecc313c6c77e on host dv-cinder-768458-12-iscsi {{(pid=109042) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 14:07:58.294373 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2f57cdde-a3c9-40c0-88f0-211e71097d2d') {'for_net_delete': True} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:58.294572 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:58.294683 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.services.segments.db [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2f57cdde-a3c9-40c0-88f0-211e71097d2d') {} {{(pid=109040) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:58.294885 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:58.295227 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:58.295575 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:58.296404 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:58.296691 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:58.297015 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:58.297349 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:58.297683 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:58.298011 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:58.298387 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:58.298718 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9dc325a-83b0-47de-8021-593c56f2e3b7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-768458-12-iscsi {{(pid=109042) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 21 14:07:58.307330 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-261998924'] for segment, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:58.321114 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:58.327537 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Releasing vlan 542 on physical network physnet1 to pool {{(pid=109040) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 14:07:58.327970 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2298122'] for segment, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: Traceback (most recent call last): Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: timer() Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: cb(*args, **kw) Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: return func(*args, **kwargs) Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: self._notify() Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: self.callback(batched_events) Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: event.method(event) Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: return f(self, *a, **k) Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._get(url).json() Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: return self.request(url, 'GET', **kwargs) Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 14:07:58.330187 dv-cinder-768458-12-iscsi neutron-server[109040]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 14:07:58.389910 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:58.395987 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:58.399359 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] 10.222.0.11 "DELETE /v2.0/networks/4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8 HTTP/1.1" status: 204 len: 168 time: 0.5288956 Nov 21 14:07:58.402316 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 60064) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:07:58.412691 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de0b629b-dc01-4b83-917a-ce6feb63ae89 admin admin] Pushing event deleted for resources: {'Network': ['ID=4ddc2f5d-1eb0-49b2-bf70-4d82c80d6dc8,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:07:58.708490 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device dbdeefa8-a396-487a-aa91-907825e1f4f0 no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 14:07:58.729460 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: dbdeefa8-a396-487a-aa91-907825e1f4f0 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 14:07:58.729808 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device dbdeefa8-a396-487a-aa91-907825e1f4f0 not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 14:07:58.730228 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device a7eec2f6-2747-4e84-adcf-05431129442c no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 14:07:58.739250 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-29b53801-da78-432d-9af4-393488139b62 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-473237'] for router_interface, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:58.757325 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: a7eec2f6-2747-4e84-adcf-05431129442c {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 14:07:58.757815 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device a7eec2f6-2747-4e84-adcf-05431129442c not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 14:07:58.758395 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device c41a3c92-fc90-499b-be69-ecc313c6c77e no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 14:07:58.782974 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: c41a3c92-fc90-499b-be69-ecc313c6c77e {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 14:07:58.783502 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device c41a3c92-fc90-499b-be69-ecc313c6c77e not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 14:07:58.984765 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-29b53801-da78-432d-9af4-393488139b62 admin admin] Deleting port 602b0509-a9ca-469e-ac5d-1511520423f7 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:07:58.984999 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-29b53801-da78-432d-9af4-393488139b62 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:59.062268 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [None req-29b53801-da78-432d-9af4-393488139b62 admin admin] For port 602b0509-a9ca-469e-ac5d-1511520423f7, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=602b0509-a9ca-469e-ac5d-1511520423f7,segment=NetworkSegment(55d0e716-c4c3-4fb4-9184-bc6611b0fac3),segment_id=55d0e716-c4c3-4fb4-9184-bc6611b0fac3)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:07:59.062625 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-29b53801-da78-432d-9af4-393488139b62 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:59.079793 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-29b53801-da78-432d-9af4-393488139b62 admin admin] Calling delete_port for 602b0509-a9ca-469e-ac5d-1511520423f7 owned by network:router_interface {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:07:59.248708 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-29b53801-da78-432d-9af4-393488139b62 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:59.272279 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29b53801-da78-432d-9af4-393488139b62 admin admin] Pushing event deleted for resources: {'Port': ['ID=602b0509-a9ca-469e-ac5d-1511520423f7,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:07:59.433169 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-29b53801-da78-432d-9af4-393488139b62 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1684491', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-473209'] for router_interface, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:07:59.639560 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-29b53801-da78-432d-9af4-393488139b62 admin admin] Router a62177be-9f50-4579-8ec7-523c26060526 has already been hosted by L3 agent 7337707a-b117-4383-a6c9-deca4cbc9695 {{(pid=109041) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 21 14:07:59.741438 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29b53801-da78-432d-9af4-393488139b62 admin admin] Notify agent at l3_agent.dv-cinder-768458-12-iscsi the message routers_updated {{(pid=109041) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 21 14:07:59.746614 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-29b53801-da78-432d-9af4-393488139b62 admin admin] 10.222.0.11 "PUT /v2.0/routers/a62177be-9f50-4579-8ec7-523c26060526/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.3432798 Nov 21 14:07:59.749208 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 60066) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:07:59.750013 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ac2fc6a-47a8-4393-8c12-b7662916f56a None None] Sync routers for ids ['a62177be-9f50-4579-8ec7-523c26060526'] in dv-cinder-768458-12-iscsi {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 21 14:07:59.760096 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ac2fc6a-47a8-4393-8c12-b7662916f56a None None] Routers {'a62177be-9f50-4579-8ec7-523c26060526'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:07:59.760714 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-7ac2fc6a-47a8-4393-8c12-b7662916f56a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:07:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['a62177be-9f50-4579-8ec7-523c26060526'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:07:59.864359 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-7ac2fc6a-47a8-4393-8c12-b7662916f56a None None] Set router a62177be-9f50-4579-8ec7-523c26060526 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:08:00.051354 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-7ac2fc6a-47a8-4393-8c12-b7662916f56a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a62177be-9f50-4579-8ec7-523c26060526', 'name': 'tempest-TestVolumeBootPattern-1599347875-router', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49'}], 'enable_snat': True}, 'gw_port_id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:20Z', 'updated_at': '2021-11-21T14:07:59Z', 'revision_number': 5, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'gw_port': {'id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:c1:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:21Z', 'updated_at': '2021-11-21T14:01:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:08:00.077576 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ac2fc6a-47a8-4393-8c12-b7662916f56a None None] Checking router: a62177be-9f50-4579-8ec7-523c26060526 for host: dv-cinder-768458-12-iscsi {{(pid=109043) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 21 14:08:00.085910 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ac2fc6a-47a8-4393-8c12-b7662916f56a None None] Routers {'a62177be-9f50-4579-8ec7-523c26060526'} bound to L3 agent in host dv-cinder-768458-12-iscsi {{(pid=109043) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 21 14:08:00.086517 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-7ac2fc6a-47a8-4393-8c12-b7662916f56a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-768458-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-21T13:44:03Z,description=,heartbeat_timestamp=2021-11-21T14:07:33Z,host='dv-cinder-768458-12-iscsi',id=7337707a-b117-4383-a6c9-deca4cbc9695,load=0,resource_versions=,resources_synced=,started_at=2021-11-21T13:44:03Z,topic='l3_agent')) {'router_ids': ['a62177be-9f50-4579-8ec7-523c26060526'], 'active': True} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:08:00.116042 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Publish callbacks [] for router, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.217145 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.238934 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-6f193626-87c1-490b-b5c3-40470fa71c12 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.276662 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_dvr_db [None req-7ac2fc6a-47a8-4393-8c12-b7662916f56a None None] Set router a62177be-9f50-4579-8ec7-523c26060526 gateway port host: dv-cinder-768458-12-iscsi {{(pid=109043) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 21 14:08:00.277026 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Deleting port 1736e9cb-1855-467f-bf4b-333bddef6d70 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:08:00.277362 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.357195 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] For port 1736e9cb-1855-467f-bf4b-333bddef6d70, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=1736e9cb-1855-467f-bf4b-333bddef6d70,segment=NetworkSegment(0c0e7cfc-5b14-4551-b79a-294ec69a8c15),segment_id=0c0e7cfc-5b14-4551-b79a-294ec69a8c15)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:08:00.357737 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.371038 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Calling delete_port for 1736e9cb-1855-467f-bf4b-333bddef6d70 owned by network:router_gateway {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:08:00.449626 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.l3_hamode_db [None req-7ac2fc6a-47a8-4393-8c12-b7662916f56a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a62177be-9f50-4579-8ec7-523c26060526', 'name': 'tempest-TestVolumeBootPattern-1599347875-router', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49'}], 'enable_snat': True}, 'gw_port_id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:20Z', 'updated_at': '2021-11-21T14:07:59Z', 'revision_number': 5, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'gw_port': {'id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:c1:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:21Z', 'updated_at': '2021-11-21T14:01:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}], 'dv-cinder-768458-12-iscsi', False) {} {{(pid=109043) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:08:00.479361 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ac2fc6a-47a8-4393-8c12-b7662916f56a None None] The sync data for ids ['a62177be-9f50-4579-8ec7-523c26060526'] in dv-cinder-768458-12-iscsi is: [{'id': 'a62177be-9f50-4579-8ec7-523c26060526', 'name': 'tempest-TestVolumeBootPattern-1599347875-router', 'tenant_id': 'fbf5da1d0dab4233b3314e754324060f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'external_fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49'}], 'enable_snat': True}, 'gw_port_id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-21T14:01:20Z', 'updated_at': '2021-11-21T14:07:59Z', 'revision_number': 5, 'project_id': 'fbf5da1d0dab4233b3314e754324060f', 'gw_port': {'id': '1736e9cb-1855-467f-bf4b-333bddef6d70', 'name': '', 'network_id': '67069811-a3d5-4953-8a57-e62d44750fe3', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:c1:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a62177be-9f50-4579-8ec7-523c26060526', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'ip_address': '172.27.1.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-768458-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-21T14:01:21Z', 'updated_at': '2021-11-21T14:01:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '95d11680-e5b5-4d2e-bab7-c3bed6fa33a8', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-768458-12-iscsi'}] {{(pid=109043) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 21 14:08:00.535880 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.564385 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Pushing event deleted for resources: {'Port': ['ID=1736e9cb-1855-467f-bf4b-333bddef6d70,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:08:00.620217 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-471003'] for router_gateway, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.710591 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-470817', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-58426'] for router, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.712730 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.757023 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-470840'] for router, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.757701 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Fanout notify agent at l3_agent the message router_deleted on router a62177be-9f50-4579-8ec7-523c26060526 {{(pid=109041) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 21 14:08:00.763194 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] Publish callbacks [] for router, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.764018 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-cafccd81-a138-4ffc-83a8-1e8092ad952f admin admin] 10.222.0.11 "DELETE /v2.0/routers/a62177be-9f50-4579-8ec7-523c26060526 HTTP/1.1" status: 204 len: 168 time: 1.0137677 Nov 21 14:08:00.766443 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 60068) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:08:00.812306 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.db_base_plugin_v2 [None req-5e0b4520-1341-4f51-81f7-7271531a37ee admin admin] Deleting subnet c1c9af2b-6794-4f3a-a1b2-f58aefe762f8 {{(pid=109041) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 21 14:08:00.816338 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5e0b4520-1341-4f51-81f7-7271531a37ee admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.855011 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5e0b4520-1341-4f51-81f7-7271531a37ee admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4028984'] for subnet, precommit_delete_associations {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.930263 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 602b0509-a9ca-469e-ac5d-1511520423f7 no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 14:08:00.951134 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5e0b4520-1341-4f51-81f7-7271531a37ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-622371'] for subnet, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:00.955237 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: 602b0509-a9ca-469e-ac5d-1511520423f7 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 14:08:00.955672 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 602b0509-a9ca-469e-ac5d-1511520423f7 not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 14:08:01.005705 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5e0b4520-1341-4f51-81f7-7271531a37ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-622376', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607616', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3086848', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-261005199'] for subnet, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.035581 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e0b4520-1341-4f51-81f7-7271531a37ee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c1c9af2b-6794-4f3a-a1b2-f58aefe762f8,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:08:01.040622 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-5e0b4520-1341-4f51-81f7-7271531a37ee admin admin] Publish callbacks [] for subnet, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.044572 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-5e0b4520-1341-4f51-81f7-7271531a37ee admin admin] 10.222.0.11 "DELETE /v2.0/subnets/c1c9af2b-6794-4f3a-a1b2-f58aefe762f8 HTTP/1.1" status: 204 len: 168 time: 0.2757733 Nov 21 14:08:01.047002 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11127faa-6a40-476d-b062-24c87018bdc4 None None] Network 0d56e568-78a2-4494-ad2a-4019474745a2 requested from dv-cinder-768458-12-iscsi {{(pid=109042) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 21 14:08:01.047669 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [-] (109041) accepted ('10.222.0.11', 60070) {{(pid=109041) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:08:01.121331 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1317210'] for network, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.175169 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Deleting port 37d17356-5acc-4725-b0f4-08bb6e5ed393 {{(pid=109041) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 21 14:08:01.175509 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731000550184'] for port, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.236597 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.db [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] For port 37d17356-5acc-4725-b0f4-08bb6e5ed393, host dv-cinder-768458-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-768458-12-iscsi',level=0,port_id=37d17356-5acc-4725-b0f4-08bb6e5ed393,segment=NetworkSegment(55d0e716-c4c3-4fb4-9184-bc6611b0fac3),segment_id=55d0e716-c4c3-4fb4-9184-bc6611b0fac3)] {{(pid=109041) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 21 14:08:01.236955 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-467454'] for port, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.249136 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.plugin [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Calling delete_port for 37d17356-5acc-4725-b0f4-08bb6e5ed393 owned by network:dhcp {{(pid=109041) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 21 14:08:01.328398 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-628520', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2066336', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731000553045', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731000071855', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3087071'] for port, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.354316 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Pushing event deleted for resources: {'Port': ['ID=37d17356-5acc-4725-b0f4-08bb6e5ed393,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:08:01.356148 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] No DVR routers for this DVR port 37d17356-5acc-4725-b0f4-08bb6e5ed393 on host dv-cinder-768458-12-iscsi {{(pid=109041) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 21 14:08:01.429517 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-619931', 'neutron.services.segments.db._delete_segments_for_network-8731000399499'] for network, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.449705 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0d56e568-78a2-4494-ad2a-4019474745a2']}} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:08:01.458964 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '55d0e716-c4c3-4fb4-9184-bc6611b0fac3') {'for_net_delete': True} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:08:01.459265 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.services.segments.db [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '55d0e716-c4c3-4fb4-9184-bc6611b0fac3') {} {{(pid=109041) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 21 14:08:01.468964 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731000641302', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4028979'] for segment, before_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.484472 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959'] for segment, precommit_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.491616 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Releasing vlan 513 on physical network physnet1 to pool {{(pid=109041) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 21 14:08:01.492124 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-606959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3087018'] for segment, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: Traceback (most recent call last): Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: timer() Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: cb(*args, **kw) Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: return func(*args, **kwargs) Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: self._notify() Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: self.callback(batched_events) Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: event.method(event) Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: aggregate_uuid = self.p_client.list_aggregates( Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: return f(self, *a, **k) Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._get(url).json() Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: return self.request(url, 'GET', **kwargs) Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: base_url = self.get_endpoint(auth, allow=allow, Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 21 14:08:01.494853 dv-cinder-768458-12-iscsi neutron-server[109041]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 21 14:08:01.499902 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d0d6f99-8d41-45e8-bd72-0c6cfdf8126c None None] DHCP port deletion for 0d56e568-78a2-4494-ad2a-4019474745a2 request from dv-cinder-768458-12-iscsi {{(pid=109042) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 21 14:08:01.550288 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-619922', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607599', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1684498', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-471015'] for network, after_delete {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.555119 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron_lib.callbacks.manager [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1684516'] for network, before_response {{(pid=109041) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.558948 dv-cinder-768458-12-iscsi neutron-server[109041]: INFO neutron.wsgi [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] 10.222.0.11 "DELETE /v2.0/networks/0d56e568-78a2-4494-ad2a-4019474745a2 HTTP/1.1" status: 204 len: 168 time: 0.5096917 Nov 21 14:08:01.571502 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0b2c3d0-82da-43f7-968b-6147d2ac129b admin admin] Pushing event deleted for resources: {'Network': ['ID=0d56e568-78a2-4494-ad2a-4019474745a2,revision_number=None']} {{(pid=109041) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:08:01.661822 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 60074) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:08:01.700631 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-f6da3a5a-1cc6-4fef-aa61-1663c86dc8c7 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=db51095fd43e4fe5855207bd0ea7a651&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0373890 Nov 21 14:08:01.702873 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 60076) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:08:01.748221 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-66cda822-6429-4f35-b62e-9dc771c5c03d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.768714 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-66cda822-6429-4f35-b62e-9dc771c5c03d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.817942 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-66cda822-6429-4f35-b62e-9dc771c5c03d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.820701 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-66cda822-6429-4f35-b62e-9dc771c5c03d admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:01.821858 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-66cda822-6429-4f35-b62e-9dc771c5c03d admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/88550b36-8ec8-436d-8a8c-4fcf2d7ea3d3 HTTP/1.1" status: 204 len: 168 time: 0.1181047 Nov 21 14:08:01.830002 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66cda822-6429-4f35-b62e-9dc771c5c03d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88550b36-8ec8-436d-8a8c-4fcf2d7ea3d3,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:08:02.137811 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 60082) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:08:02.176639 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-86b3e989-d6c0-49dc-a22f-5c3292867ab9 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=fbf5da1d0dab4233b3314e754324060f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0375965 Nov 21 14:08:02.179064 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [-] (109040) accepted ('10.222.0.11', 60084) {{(pid=109040) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 21 14:08:02.224317 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-64859a0c-b2a5-4c97-82c3-421b667edfc3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:02.244369 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-64859a0c-b2a5-4c97-82c3-421b667edfc3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:02.293070 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-64859a0c-b2a5-4c97-82c3-421b667edfc3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1607448'] for security_group, after_delete {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:02.296073 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron_lib.callbacks.manager [None req-64859a0c-b2a5-4c97-82c3-421b667edfc3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109040) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:02.297308 dv-cinder-768458-12-iscsi neutron-server[109040]: INFO neutron.wsgi [None req-64859a0c-b2a5-4c97-82c3-421b667edfc3 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/84d4b291-76b2-49d2-829a-d3327e04a971 HTTP/1.1" status: 204 len: 168 time: 0.1172895 Nov 21 14:08:02.305686 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64859a0c-b2a5-4c97-82c3-421b667edfc3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=84d4b291-76b2-49d2-829a-d3327e04a971,revision_number=None']} {{(pid=109040) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 21 14:08:02.593878 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-88bdf2a0-b2f6-4a9e-8349-553f3c1a73b8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:02.707411 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 37d17356-5acc-4725-b0f4-08bb6e5ed393 no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 14:08:02.731108 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: 37d17356-5acc-4725-b0f4-08bb6e5ed393 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 14:08:02.731446 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 37d17356-5acc-4725-b0f4-08bb6e5ed393 not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 14:08:02.731879 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 1736e9cb-1855-467f-bf4b-333bddef6d70 no longer exists at agent ovs-agent-dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 21 14:08:02.750359 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.plugin [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] No Port match for: 1736e9cb-1855-467f-bf4b-333bddef6d70 {{(pid=109042) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 21 14:08:02.750699 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron.plugins.ml2.rpc [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Device 1736e9cb-1855-467f-bf4b-333bddef6d70 not bound to the agent host dv-cinder-768458-12-iscsi {{(pid=109042) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 21 14:08:03.938670 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:05.132710 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:05.890064 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:22.600415 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:08:22.779940 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:30.241116 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-7f3f5f0a-caf8-4c13-8bbd-682edd875d59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:32.596673 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-8352d9f2-7b88-42c8-9971-87af0c229116 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:33.941631 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:35.135111 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:35.891102 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:52.788342 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:08:59.600092 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:09:00.241955 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-2dd84d75-9f26-4ea1-9f14-097d828366e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:09:02.597539 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-55ee5984-d42f-430d-ab73-932d320b8073 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:09:03.944401 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:09:05.138278 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:09:05.895341 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:09:22.794554 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:09:30.244186 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-74cef40c-7a24-447c-9518-03470e1073ef None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:09:32.598644 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-54f50c0c-c641-4d94-9f42-493c6a86ccd6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:09:33.946892 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:09:35.141695 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:09:35.898297 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:09:36.600052 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:09:52.793610 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:10:00.246039 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5e5f9404-80c5-4a3d-ad30-aac5c51bd0d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:10:02.600568 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-981722ab-635e-4985-b45e-020cdc9bc13e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:10:04.068280 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:10:05.144939 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:10:05.900550 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:10:13.598981 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:10:22.808575 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:10:30.247747 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-2bdaeac9-9982-4787-9bac-ba6180a2a102 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:10:32.600542 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-bb49be57-7953-41fa-bdd4-f133e3276f74 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:10:33.952087 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:10:35.146858 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:10:35.903070 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:10:50.601272 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:10:52.808232 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:11:00.249370 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-5dcc6eaf-a246-446e-a8b7-b84a7538499d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:11:02.600713 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-df885702-be16-4d85-8ce5-5e7ef0242012 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:11:03.956645 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:11:05.149553 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:11:05.906804 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:11:22.816097 dv-cinder-768458-12-iscsi neutron-server[109041]: DEBUG neutron.wsgi [req-45220a7b-d707-45c3-9908-467395f51241 req-edb68829-b3b8-4cc2-ac0c-a709d44a177f service neutron] (109041) timed out ('10.222.0.50', 61769) {{(pid=109041) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 21 14:11:22.817835 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:11:27.600338 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:11:30.251194 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-33ea1413-619c-4f4f-92ec-424fe8c128df None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:11:32.602252 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-91386ac0-7140-4e3e-955d-249e5b461d9e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:11:33.957391 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:11:35.153667 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:11:35.909601 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:11:52.821873 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:11:54.452019 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [req-ce02a582-e94d-4a0f-8efb-2f6fa43e9d1c req-56aadef4-b93b-4234-bfdb-8a3a33c1b922 service neutron] (109040) timed out ('10.222.0.11', 54112) {{(pid=109040) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 21 14:12:00.252832 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-85375b8c-f6fe-4da6-a63c-36ed916d3776 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:12:02.603859 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-c2037595-574b-449a-8217-4207365554ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:12:03.959486 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:12:04.599151 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:12:05.157268 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:12:05.911502 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:12:22.822493 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:12:30.257758 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-82352d5c-e874-4f6a-9e57-29dfbb3ed31b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:12:32.604599 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-54a8bf9a-b236-4ff5-a5d9-04865a64fb56 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:12:33.962979 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:12:35.161323 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:12:35.895204 dv-cinder-768458-12-iscsi neutron-server[109040]: DEBUG neutron.wsgi [req-335b2c6e-e111-4539-a712-022677b3804d req-b88517d0-4b8c-4ee2-94e7-a80d8bfef2cd service neutron] (109040) timed out ('10.222.0.11', 56706) {{(pid=109040) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 21 14:12:35.912650 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:12:41.598213 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 21 14:12:52.842598 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ae24bb0a-a78c-4659-9583-21b210056984 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:13:00.259732 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-cc76dacd-315c-44c7-88f3-2649b0d2b2c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:13:02.606237 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-b9150a34-4a95-405e-b971-da8a46cf42e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:13:03.966288 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-fb7af479-c61a-4f9b-9eb4-f4fa5d04f2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:13:05.163670 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-ee3a488c-1e21-486b-9b07-2540f1e9dfc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:13:05.914619 dv-cinder-768458-12-iscsi neutron-server[109042]: DEBUG neutron_lib.callbacks.manager [None req-0666ef85-4d11-41ee-93f1-63e8e747958b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731000399571', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-635710'] for agent, after_update {{(pid=109042) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 21 14:13:18.597309 dv-cinder-768458-12-iscsi neutron-server[109043]: DEBUG neutron.db.agents_db [None req-c3402715-1dc8-4e9d-9adb-919b1c7bc82b None None] Agent healthcheck: found 6 active agents {{(pid=109043) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}